-- Logs begin at Mon 2022-09-19 10:40:17 UTC, end at Mon 2022-09-19 11:44:47 UTC. -- Sep 19 11:14:52.045469 dv-cinder-820994-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 11:14:52.054150 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:14:52 2022] *** Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: nodename: dv-cinder-820994-5-iscsi Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: machine: x86_64 Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: clock source: unix Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: pcre jit disabled Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: detected number of CPU cores: 4 Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: current working directory: / Sep 19 11:14:52.056160 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: your processes number limit is 47680 Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: your memory page size is 4096 bytes Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: detected max file descriptor number: 2048 Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: lock engine: pthread robust mutexes Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: thunder lock: enabled Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 11:14:52.056858 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:14:52.097104 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: Python main interpreter initialized at 0x55ec6c4e49c0 Sep 19 11:14:52.097104 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: python threads support enabled Sep 19 11:14:52.097104 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: your server socket listen backlog is limited to 100 connections Sep 19 11:14:52.097104 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:14:52.097430 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:14:52.097516 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: *** Operational MODE: preforking *** Sep 19 11:14:52.097756 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:14:52.097756 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: spawned uWSGI master process (pid: 105468) Sep 19 11:14:52.097939 dv-cinder-820994-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 11:14:52.098485 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: spawned uWSGI worker 1 (pid: 105469, cores: 1) Sep 19 11:14:52.098817 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: spawned uWSGI worker 2 (pid: 105470, cores: 1) Sep 19 11:14:52.098972 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:14:52.758144 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:14:52.758828 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:14:53.847856 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:14:53.847856 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: from cryptography.utils import int_from_bytes Sep 19 11:14:53.848450 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:14:53.848450 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: from cryptography.utils import int_from_bytes Sep 19 11:14:53.848894 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:14:53.848894 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: from cryptography.utils import int_from_bytes Sep 19 11:14:53.849330 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:14:53.849330 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: from cryptography.utils import int_from_bytes Sep 19 11:14:56.342613 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:14:56.343173 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:14:56.343383 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:14:56.343740 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:14:56.344018 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:14:56.344402 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.344723 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.345042 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.345358 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.345682 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.345991 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.346305 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.346619 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.346941 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.347196 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.347509 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.347864 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-5-iscsi {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.348184 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.348287 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:14:56.348667 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.348750 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:14:56.348839 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.349018 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:14:56.349112 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.349361 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.349451 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:14:56.349618 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:14:56.349711 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.349963 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.350054 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.350313 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.350466 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.350865 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.350998 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351104 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351213 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351318 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351467 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351588 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351828 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.351962 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.352680 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.352782 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.352989 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.353092 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.353280 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.353374 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.353596 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.353682 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.353926 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354084 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-5-iscsi {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354219 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354311 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354527 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354620 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-5-iscsi {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354837 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.354923 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.355155 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.355292 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.355459 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.355552 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.355798 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.355905 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.356107 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.356209 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.356508 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.356636 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.356825 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.356937 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.357169 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.357265 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.357459 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.357562 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.357780 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.357867 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.358094 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.358194 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.358401 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.358487 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.358713 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.358820 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359011 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359099 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359318 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359406 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359622 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359719 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.359959 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360047 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-5-iscsi {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360261 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360355 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360559 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360646 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360813 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.360918 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.361116 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.361322 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.361448 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.361632 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.361719 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.361940 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362039 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362259 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362347 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362501 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362601 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362816 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.362905 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.363133 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.363226 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.363435 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.363542 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.363739 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.363855 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364069 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364219 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364370 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364515 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364803 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.364976 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365122 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365265 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365393 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365568 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365657 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365870 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.365963 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.366122 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.366209 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.366428 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.366514 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.366750 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.366849 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.367065 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.367154 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.367385 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.367491 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.367673 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.368378 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.368464 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.368573 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.368757 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.368910 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369077 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369228 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369383 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369533 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369691 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369849 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.369998 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.370164 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.370302 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.370468 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.370606 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.370778 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.370909 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.371079 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.371211 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.371394 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.371513 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.371720 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.371838 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372046 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372139 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372294 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372459 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372592 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372767 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.372891 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.373087 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.373204 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.373483 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.373569 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.373735 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.373821 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374039 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374125 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374363 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374451 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374666 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374763 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.374968 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375053 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375268 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375370 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375569 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375892 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.375993 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.376195 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.376290 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.376495 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.376580 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.376800 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.376923 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377102 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377219 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377403 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377504 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377651 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377754 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.377952 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378058 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378253 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378429 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378569 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378671 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378873 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.378969 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.379170 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.379254 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.379473 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.379556 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.379779 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.379882 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380091 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380178 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380390 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380482 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380695 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380789 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.380994 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381085 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381294 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381377 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381592 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381678 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381892 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.381979 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.382194 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.382285 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.382486 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.382577 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.382787 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.382873 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.383098 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.383182 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.383440 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.383539 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.383747 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.383854 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384071 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384168 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384400 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384565 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384680 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384772 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.384982 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385067 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385282 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385369 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385581 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385716 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385877 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.385980 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.386187 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.386279 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.386490 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.386575 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.386790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.386901 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.387095 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.387200 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.387394 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.387492 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.387707 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.387834 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.388027 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.388121 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.388332 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.388418 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.388647 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.388748 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.388949 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.389042 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.389253 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.389339 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.389554 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.389641 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.389856 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.389951 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.390242 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.390349 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.390553 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.390646 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.390857 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.390943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.391161 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.391246 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.391459 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.391552 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.391785 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.391886 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.392101 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.392186 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.392409 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.392501 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.392715 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.392811 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.393020 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.393115 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.393328 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.393414 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:14:56.393641 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.393726 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.393950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.394043 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.394263 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.394356 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.394586 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.394680 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.394900 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395011 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395202 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395289 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395537 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395622 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395874 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.395981 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.396191 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.396277 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.396514 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.396598 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.396823 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.396920 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.397133 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.397249 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.397440 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.397540 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.397746 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.397854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.398060 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.398163 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.398380 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.398502 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.398688 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.398793 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399024 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399139 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399330 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399425 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399639 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399735 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.399972 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400068 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400281 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400378 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400590 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400688 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400895 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.400991 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.401199 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.401302 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.401529 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.401633 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.401839 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.401934 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.402153 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.402258 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.402461 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.402557 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.402768 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.402866 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.403076 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.403219 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.403382 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.403477 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.403688 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.403805 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404020 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404128 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404322 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404426 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404622 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404735 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.404923 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405093 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405228 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405315 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405529 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405626 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405842 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.405981 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.406155 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.406240 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.406452 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.406545 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.406766 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.406852 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.407066 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.407152 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.407375 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.407472 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.407677 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.407823 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408010 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408112 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408308 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408395 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408614 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408708 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.408924 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409010 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409226 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409313 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409534 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409626 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409837 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.409921 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.410137 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.410235 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.410438 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.410524 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.410747 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.410832 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411048 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411145 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411356 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411440 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411662 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411747 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.411993 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.412094 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.412300 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.412384 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.412606 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.412691 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.412915 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413012 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413220 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413378 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413528 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413612 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413831 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.413918 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.414145 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.414231 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.414450 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.415112 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.415286 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.415372 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.415608 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.415694 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.415944 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416075 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416244 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416339 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416551 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416637 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416851 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.416938 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.417150 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.417244 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.417449 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.417547 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.417751 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.417846 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418050 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418205 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418335 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418469 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418644 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418791 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.418945 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419078 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419211 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419351 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419507 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419650 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419833 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.419968 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.420134 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.420269 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.420433 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.420572 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.420730 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.420869 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421065 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421213 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421354 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421494 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421687 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421822 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.421994 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.422130 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.422297 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.422433 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.422600 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.422730 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.422901 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423036 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423209 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423352 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423510 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423646 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423833 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.423966 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.424139 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.424283 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.424441 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.424576 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.424748 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.424908 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425043 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425178 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425353 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425484 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425653 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.425956 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426090 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426385 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426569 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426719 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426855 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.426988 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.427166 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.427301 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.427503 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.427634 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.427841 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.427936 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.428157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.428257 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.428463 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.428553 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.428769 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.428863 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429077 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429176 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429380 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429468 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429686 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429772 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.429991 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.430078 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.430868 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.430968 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.431191 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.431278 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.431497 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.431582 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.431828 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.431919 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.432140 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.432237 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.432448 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.432534 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.432749 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.432837 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433057 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433152 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433356 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433459 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433664 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433759 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.433987 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.434075 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.434313 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.434476 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.434615 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.434709 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.434920 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435242 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435410 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435547 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435681 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435864 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.435993 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.436162 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.436314 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.436461 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.436546 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.436763 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.436850 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437067 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437154 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437377 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437462 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437685 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437782 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.437989 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438077 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438290 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438376 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438599 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438690 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438900 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.438986 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.439196 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.439288 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.439495 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.439580 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.439821 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.439912 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.440142 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.440227 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.440448 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.440546 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.440765 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.440854 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441076 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441175 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441379 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441473 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441678 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441764 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.441980 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442065 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442285 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442379 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442583 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442667 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442882 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.442969 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.443179 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.443273 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.443488 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.443582 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.443808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.443907 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.444126 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.444219 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.444433 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.444520 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.444742 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.444828 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.445295 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.445426 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.445603 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.445688 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.445947 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.446078 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.446259 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.446428 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.446580 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.446836 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.446937 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.447188 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.447286 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.447493 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.447580 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.447829 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.447917 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.448123 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.448229 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.448427 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.448528 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.448731 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.448825 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449035 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449122 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449347 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449431 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449659 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449744 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.449961 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450047 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450259 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450343 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450565 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450652 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450876 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.450961 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.451190 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.451443 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.451529 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.451786 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.451888 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.452107 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.452193 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.452421 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.452504 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.452733 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.452821 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453044 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453139 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453355 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453441 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453665 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453760 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.453974 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454068 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454274 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454366 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454579 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454673 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454879 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.454965 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.455182 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.455276 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.455484 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.455577 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.455801 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.455891 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.456108 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.456194 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.456410 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.456667 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.456755 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457000 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457095 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457296 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457389 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457594 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457679 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457895 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.457993 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.458202 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.458302 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.458502 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.458665 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.458808 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.458894 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.459107 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.459210 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.459424 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.459524 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.459729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.459833 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460052 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460137 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460352 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460441 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460651 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460736 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.460970 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.461055 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.461276 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.461363 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.461607 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.461701 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.461915 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462001 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462217 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462304 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462519 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462604 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462820 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.462913 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.463123 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.463208 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.463434 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.463519 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.463732 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.463900 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464063 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464151 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464364 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464449 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464669 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464762 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.464970 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465057 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465275 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465366 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465579 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465676 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465884 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.465970 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.466188 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.466271 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.466487 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.466581 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.466794 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.466879 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.467094 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.467186 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.467404 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.467496 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.467709 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.467852 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468040 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468158 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468347 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468461 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468654 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468761 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.468962 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469083 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469262 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469369 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469568 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469665 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469867 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.469973 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.470168 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.470271 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.470469 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.470564 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.470770 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.470880 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.471076 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.471172 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.471383 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.471487 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.471687 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.471820 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472019 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472127 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472321 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472416 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472630 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472718 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.472933 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473023 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473235 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473321 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473541 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473637 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473840 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.473927 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.474141 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.474229 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.474444 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.474538 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.474761 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.474857 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.475068 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.475164 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.475368 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.475463 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.475677 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.475868 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476103 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476303 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476396 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476601 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476688 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.476907 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.477490 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.477722 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.477808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478021 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478120 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478324 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478623 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478730 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.478923 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479021 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479234 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479360 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479538 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479642 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479864 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.479961 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.480164 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.480263 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.480463 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.480551 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.480787 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.480875 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.481086 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.481181 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.481395 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.481482 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.481700 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.481788 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482005 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482093 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482309 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482398 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482615 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482703 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.482917 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483005 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483219 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483305 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483515 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483602 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483836 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.483928 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.484144 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.484233 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.484455 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.484561 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.484748 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.484835 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485045 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485133 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485357 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485451 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485661 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485769 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.485972 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.486072 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.486285 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.486382 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.486600 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.486701 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.486920 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487019 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487215 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487383 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487518 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487606 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487849 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.487938 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.488157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.488246 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.488460 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.488554 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.488762 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.488853 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489064 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489161 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489371 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489459 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489675 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489763 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.489974 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490061 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490275 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490363 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490574 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490660 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490878 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.490967 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.491182 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.491271 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.491483 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.491583 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.491823 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.491917 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.492130 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.492217 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.492429 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.492529 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.492785 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.492882 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.493095 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.493191 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.493399 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.493495 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.493697 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.493785 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494004 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494113 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494315 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494412 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494627 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494715 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.494938 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495027 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495253 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495343 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495561 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495656 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495887 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.495992 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.496202 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.496302 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.496496 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.496582 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.496795 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.496900 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.497118 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.497217 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.497425 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.497513 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.497726 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.497814 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498034 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498123 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498337 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498425 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498639 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498736 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.498937 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499025 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499242 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499356 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499540 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499647 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499860 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.499988 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.500178 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.500277 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.500476 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.500573 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.500789 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.500875 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.501186 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.501272 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.501489 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.501584 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.501790 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.501877 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.502194 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.502289 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.502500 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.502588 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.502805 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.502899 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.503111 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.503233 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.503415 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.503504 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.503716 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.503861 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504044 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504138 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504352 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504450 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504652 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504738 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.504952 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505039 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505260 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505349 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505563 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505665 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505866 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.505954 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.506161 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.506307 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.506478 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.506569 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.506794 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.506881 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.507100 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.507199 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.507416 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.507550 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.507844 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.507953 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.508163 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.508749 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.508983 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.509074 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.509299 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.509386 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.509619 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.509716 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.509916 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510215 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510302 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510520 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510617 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510817 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.510905 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.511116 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.511204 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.511432 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.511529 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.511729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.511835 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512061 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512186 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512365 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512468 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512668 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512758 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.512968 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513054 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513267 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513355 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513583 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513680 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513882 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.513982 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.514196 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.514285 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.514528 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.514623 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.514818 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.514913 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.515142 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.515273 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.515431 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.515517 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.515784 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.515897 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516076 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516163 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516381 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516532 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516672 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516818 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.516956 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517100 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517279 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517369 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517579 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517680 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517887 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.517975 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.518190 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.518318 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.518492 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.518582 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.518808 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.518895 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.519110 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.519246 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.519430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.519578 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.519740 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.519844 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520071 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520168 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520383 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520472 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520687 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520782 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.520989 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521083 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521290 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521379 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521595 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521688 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521893 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.521994 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.522196 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.522286 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.522490 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.522576 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.522791 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.522888 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.523089 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.523177 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.523386 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.523481 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.523683 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.523814 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524073 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524199 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524511 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524688 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524821 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.524992 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525124 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525289 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525382 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525588 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525679 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525886 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.525985 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.526219 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.526310 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.526519 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.526610 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.526829 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.526917 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.527131 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.527232 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.527436 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.527526 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.527739 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.527848 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528068 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528158 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528368 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528458 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528669 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528764 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.528971 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529116 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529280 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529367 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529581 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529669 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529885 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.529979 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.530195 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.530283 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.530496 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.530592 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.530799 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.530895 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.531099 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.531312 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.531437 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.531642 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.531739 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.531983 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.532074 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.532304 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.532420 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.532616 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.532717 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.532927 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533014 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533238 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533333 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533547 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533643 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533857 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.533952 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.534167 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.534266 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.534472 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.534568 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.534784 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.534870 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.535093 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.535179 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.535409 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.535497 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.535730 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.535855 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.536071 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.536165 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.536383 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.536587 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.536734 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.536916 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537051 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537229 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537390 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537531 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537672 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537841 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.537974 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.538154 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.538293 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.538468 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.538605 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.538780 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.538917 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.539091 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.539237 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.539400 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540067 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540346 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540563 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540652 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540872 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.540961 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.541178 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.541275 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.541491 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.541579 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.541802 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.541890 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.542123 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.542219 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.542439 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.542527 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.542752 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.542847 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.543061 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.543162 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.543374 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.543526 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.543686 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.543793 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544029 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544221 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544343 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544531 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544656 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544858 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.544954 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.545178 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.545267 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.545496 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.545583 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.545803 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.545900 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.546117 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.546214 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.546437 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.546525 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.546738 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.546828 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547041 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547130 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547350 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547439 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547658 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547747 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.547986 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.548084 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.548304 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.548393 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.548612 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.548749 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.548911 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.549000 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.549227 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.549426 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.549542 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.549743 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.550048 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.550137 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.550382 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.550478 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.550693 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.550779 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551097 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551321 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551421 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551631 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551718 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.551960 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552050 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552267 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552365 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552577 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552673 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552878 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.552968 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.553179 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.553268 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.553483 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.553571 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.553783 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.553871 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554084 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554172 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554389 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554475 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554696 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554784 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.554998 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.555794 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.555895 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.556148 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.556238 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.556475 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.556781 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.556909 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.557089 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.557250 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.557391 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.557582 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.557699 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.557905 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558000 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558225 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558312 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558553 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558642 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558864 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.558950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.559168 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.559252 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.559469 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.559565 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.559789 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.559878 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.560094 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.560204 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.560401 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.560494 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.560710 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.560796 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561022 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561117 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561327 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561413 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561636 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561721 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.561937 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562034 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562237 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562324 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562557 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562665 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562859 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.562957 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.563165 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.563253 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.563471 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.563558 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.563782 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.563885 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.564100 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.564190 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.564403 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.564491 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.564706 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.564947 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565083 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565280 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565400 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565595 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565694 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565896 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.565984 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.566205 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.566293 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.566536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.566631 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.566846 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.566943 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.567145 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.567241 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.567467 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.567569 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.567797 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.568115 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.568211 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.568424 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.568661 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.568758 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.569026 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.569231 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.569327 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.569625 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.569810 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.570176 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.570491 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.570668 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.570905 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.571216 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.571314 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.571522 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.571846 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.571938 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.572174 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.572484 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.572585 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.572827 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.573091 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.573179 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.573443 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.573730 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.573827 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574057 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574145 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574365 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574453 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574694 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574793 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.574973 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.575063 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.575277 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.575366 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.575588 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.575678 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.575941 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.576044 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.576255 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.576364 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.576557 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.576820 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.577227 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.577415 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.577542 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.577862 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.577975 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.578182 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.578492 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.578578 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.578813 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.579065 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.579153 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.579395 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.579497 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.579721 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.579922 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.580054 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.580150 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.580372 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.580459 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.580689 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.580786 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581006 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581095 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581322 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581410 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581624 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581719 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.581926 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582022 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582228 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582324 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582534 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582635 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582853 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.582988 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.583159 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.583247 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.583458 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.583548 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.583814 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.583918 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584087 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584175 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584403 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584502 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584690 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584783 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.584988 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585084 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585289 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585450 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585683 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585774 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585882 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.585980 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.586192 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.586290 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.586518 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.586817 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.587116 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.587415 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.587718 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.587824 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588044 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588132 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588345 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588512 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588642 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588732 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.588940 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589029 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589238 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589331 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589562 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589650 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589889 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.589980 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.590197 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.590294 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.590513 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.590601 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.590818 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.590914 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.591134 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.591224 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.591439 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.591528 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.591755 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.591888 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.592093 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.592182 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.592405 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.592493 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.592763 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.592867 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593066 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593164 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593336 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593425 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593640 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593737 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.593943 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594031 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594246 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594341 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594550 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594651 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594855 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.594951 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.595161 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.595257 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.595466 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.595562 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.595789 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.595892 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.596107 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.596196 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.596411 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.596500 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.596726 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.596814 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597034 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597123 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597338 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597425 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597640 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597743 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.597942 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598039 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598246 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598333 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598549 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598644 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598853 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.598952 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.599155 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.599249 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.599459 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.599548 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.599773 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.599917 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.600110 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.600198 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.600425 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.600508 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.600738 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.600835 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.601056 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.601143 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.601369 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.601458 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.601674 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.601762 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.602510 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.602606 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.602831 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.602927 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.603150 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.603245 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.603466 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.603555 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.603798 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.603891 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.604136 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.604226 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.604443 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.604530 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.604751 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.604838 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.605054 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.605146 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.605294 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:14:56.605386 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.605655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.605965 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.606291 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.606619 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.606928 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.607251 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.607570 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.607924 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.608252 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.608568 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.608897 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.609211 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.609525 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.609836 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.610147 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.610460 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.610779 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.611094 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.611408 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.611730 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.612081 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.612411 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.612741 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.613054 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.613382 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.613707 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.614054 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.614369 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.614710 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.615039 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.615354 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.615668 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.616006 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:14:56.616251 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105469) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:14:56.757569 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO dbcounter [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Registered counter for database nova_api Sep 19 11:14:56.767062 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO dbcounter [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Registered counter for database nova_api Sep 19 11:14:56.778810 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_db.sqlalchemy.engines [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:56.785330 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writer thread running {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:56.787340 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_db.sqlalchemy.engines [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:56.794353 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writer thread running {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:56.843651 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.context [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c575dc0f-6975-4ee0-be74-9be0c3940462(cell1) {{(pid=105470) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:14:56.847495 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:14:56.847999 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:14:56.849554 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:14:56.850271 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:14:56.850713 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:14:56.851007 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.context [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c575dc0f-6975-4ee0-be74-9be0c3940462(cell1) {{(pid=105469) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:14:56.853273 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:14:56.855263 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO dbcounter [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Registered counter for database nova_cell0 Sep 19 11:14:56.855410 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_concurrency.lockutils [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:14:56.855906 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_concurrency.lockutils [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:14:56.857466 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_concurrency.lockutils [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:14:56.858193 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_concurrency.lockutils [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:14:56.858639 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_concurrency.lockutils [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:14:56.859869 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO dbcounter [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Registered counter for database nova_cell1 Sep 19 11:14:56.860649 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_concurrency.lockutils [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105469) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:14:56.862646 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO dbcounter [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Registered counter for database nova_cell0 Sep 19 11:14:56.866704 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO dbcounter [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Registered counter for database nova_cell1 Sep 19 11:14:56.867148 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_db.sqlalchemy.engines [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:56.868957 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_db.sqlalchemy.engines [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:56.873821 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_db.sqlalchemy.engines [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:56.874931 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writer thread running {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:56.877822 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_db.sqlalchemy.engines [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:56.879861 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writer thread running {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:56.881205 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writer thread running {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:57.019663 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writer thread running {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:57.021737 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO dbcounter [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Registered counter for database nova_cell0 Sep 19 11:14:57.029758 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO dbcounter [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Registered counter for database nova_cell0 Sep 19 11:14:57.030346 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_db.sqlalchemy.engines [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:57.034937 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writer thread running {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:57.038381 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG oslo_db.sqlalchemy.engines [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105469) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:14:57.043649 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writer thread running {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:14:57.377824 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: WARNING keystonemiddleware.auth_token [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:14:57.379924 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: WARNING keystonemiddleware.auth_token [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:14:57.385127 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: WARNING keystonemiddleware.auth_token [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:14:57.387377 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: WARNING keystonemiddleware.auth_token [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:14:57.729177 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: WARNING keystonemiddleware.auth_token [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:14:57.729820 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: WARNING keystonemiddleware.auth_token [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:14:57.735126 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: WARNING keystonemiddleware.auth_token [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:14:57.735738 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: WARNING keystonemiddleware.auth_token [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:14:57.740393 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ec6c4e49c0 pid: 105469 (default app) Sep 19 11:14:57.741242 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ec6c4e49c0 pid: 105470 (default app) Sep 19 11:14:57.743132 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:14:57.744343 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ef01a455-c1e3-4a06-a843-18cb5f0ea4af None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002436 Sep 19 11:14:57.744755 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Mon Sep 19 11:14:57 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:18.596780 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:18.597901 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Sep 19 11:16:18.599887 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:18.609617 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_api:SELECT=3 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:18.610714 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_cell0:SELECT=3 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:18.613170 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_cell1:SELECT=3 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:18.614341 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:19.510472 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-48336a09-2d71-43f2-b71b-f2c76a348f12 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:19.542307 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-48336a09-2d71-43f2-b71b-f2c76a348f12 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938270 Sep 19 11:16:19.543066 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 2/3] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 11:16:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:22.177338 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:22.178329 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-d924ff75-4f37-4db9-89bf-0b890a92ccfa None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 19 11:16:22.180066 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 2/4] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:22.621106 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-3e78de4e-3359-4e4e-843f-4fdd4cb80cf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "vcpus": 1, "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:22.669962 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-3e78de4e-3359-4e4e-843f-4fdd4cb80cf3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.485171 Sep 19 11:16:22.670539 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 3/5] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:16:22.684958 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_api:SELECT=3 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:22.685760 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_cell0:SELECT=3 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:22.688944 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_cell1:SELECT=3 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:22.689772 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:22.894190 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-642a9b15-38d9-470b-b6fa-a1594257e1fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:22.963195 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-642a9b15-38d9-470b-b6fa-a1594257e1fe admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283540 Sep 19 11:16:22.963922 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 3/6] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 11:16:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:16:25.589999 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-3e78de4e-3359-4e4e-843f-4fdd4cb80cf3 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:25.591587 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-3e78de4e-3359-4e4e-843f-4fdd4cb80cf3 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002115 Sep 19 11:16:25.592256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 4/7] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:26.244620 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-4d890741-f78c-42a1-88ad-3d8b53fd18d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "swap": 0, "disk": 5, "name": "ds512M"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:26.284534 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-4d890741-f78c-42a1-88ad-3d8b53fd18d1 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686370 Sep 19 11:16:26.285095 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 4/8] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:16:26.297143 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-84267f76-3be7-4237-95f9-ee1febef36df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:26.340853 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-84267f76-3be7-4237-95f9-ee1febef36df admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047550 Sep 19 11:16:26.341443 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 5/9] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 11:16:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:28.961392 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-4d890741-f78c-42a1-88ad-3d8b53fd18d1 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:28.962395 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-4d890741-f78c-42a1-88ad-3d8b53fd18d1 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 19 11:16:28.962802 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:29.382190 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-34238234-5b92-4405-9451-e28992a386a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:29.402193 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-34238234-5b92-4405-9451-e28992a386a0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432650 Sep 19 11:16:29.402752 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 6/11] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:29.415615 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-fa4d25e3-a262-42a6-abdc-65b669eb3895 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:29.447195 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-fa4d25e3-a262-42a6-abdc-65b669eb3895 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035912 Sep 19 11:16:29.447820 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 6/12] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 11:16:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:32.100882 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-34238234-5b92-4405-9451-e28992a386a0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:32.101895 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-34238234-5b92-4405-9451-e28992a386a0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 19 11:16:32.102298 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 7/13] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:32.520695 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-b36ebddb-ad33-4749-a8b6-f75dc94b8eb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:32.542524 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-b36ebddb-ad33-4749-a8b6-f75dc94b8eb0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433826 Sep 19 11:16:32.543342 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 7/14] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:32.556038 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-3b019a7f-8abd-451d-a5af-532c71519b02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:32.583440 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-3b019a7f-8abd-451d-a5af-532c71519b02 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031042 Sep 19 11:16:32.584065 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 8/15] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 11:16:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:35.271178 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-b36ebddb-ad33-4749-a8b6-f75dc94b8eb0 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:35.272104 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-b36ebddb-ad33-4749-a8b6-f75dc94b8eb0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 19 11:16:35.272506 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 8/16] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:35.727259 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-2358b186-5b8e-4d69-9c63-c3feb867dc6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:35.751968 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-2358b186-5b8e-4d69-9c63-c3feb867dc6a admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472881 Sep 19 11:16:35.753141 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 9/17] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:35.764965 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-3660c589-b8f6-4875-88bd-8971b8c1caa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:35.792635 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-3660c589-b8f6-4875-88bd-8971b8c1caa8 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030830 Sep 19 11:16:35.794181 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 9/18] 10.222.0.81 () {64 vars in 1336 bytes} [Mon Sep 19 11:16:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:39.005660 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-2358b186-5b8e-4d69-9c63-c3feb867dc6a admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:39.006691 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-2358b186-5b8e-4d69-9c63-c3feb867dc6a admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 19 11:16:39.007093 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 10/19] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:16:39.474115 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-fd622743-a1aa-4a61-a0cd-a054fe1cad68 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:39.500658 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-fd622743-a1aa-4a61-a0cd-a054fe1cad68 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.485638 Sep 19 11:16:39.501291 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 10/20] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 11:16:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:16:42.243098 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-2358b186-5b8e-4d69-9c63-c3feb867dc6a admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:42.244139 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-2358b186-5b8e-4d69-9c63-c3feb867dc6a admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 19 11:16:42.244540 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 11/21] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:42.656699 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-a07dbb96-256c-4828-b710-0c9a7665307e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:42.676845 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-a07dbb96-256c-4828-b710-0c9a7665307e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425802 Sep 19 11:16:42.677393 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 11/22] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:16:42.690071 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-f30505f5-733e-4981-a01b-c084384da9e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:42.715711 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-f30505f5-733e-4981-a01b-c084384da9e6 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030050 Sep 19 11:16:42.716464 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 12/23] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 11:16:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:45.357088 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-a07dbb96-256c-4828-b710-0c9a7665307e admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:45.358088 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-a07dbb96-256c-4828-b710-0c9a7665307e admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 19 11:16:45.358486 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 12/24] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:45.754639 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-9a68a1ce-9fb1-4d2a-84bc-63af81995569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "vcpus": 1, "id": "2", "rxtx_factor": 1.0}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:45.774556 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-9a68a1ce-9fb1-4d2a-84bc-63af81995569 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409618 Sep 19 11:16:45.775441 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 13/25] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:45.787953 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-3c82ee16-e38a-4b01-aa18-3791ca12d2e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:45.819257 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-3c82ee16-e38a-4b01-aa18-3791ca12d2e0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034836 Sep 19 11:16:45.819863 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 13/26] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 11:16:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:16:48.474301 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-9a68a1ce-9fb1-4d2a-84bc-63af81995569 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:48.475323 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-9a68a1ce-9fb1-4d2a-84bc-63af81995569 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 19 11:16:48.475725 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 14/27] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:48.915091 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-3d61ab51-a1f5-4307-8049-2019f9047018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "id": "3", "ram": 4096, "disk": 40}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:48.943043 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-3d61ab51-a1f5-4307-8049-2019f9047018 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.461242 Sep 19 11:16:48.951803 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 14/28] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:48 2022] POST /compute/v2.1/flavors => generated 406 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:48.957801 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-62d622cb-325c-49dd-a23f-16814591200e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:48.963483 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:49.016082 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-62d622cb-325c-49dd-a23f-16814591200e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.061961 Sep 19 11:16:49.017509 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 15/29] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 11:16:48 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:16:51.684990 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-3d61ab51-a1f5-4307-8049-2019f9047018 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:51.685998 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-3d61ab51-a1f5-4307-8049-2019f9047018 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 19 11:16:51.686394 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 15/30] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:52.132651 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e852554b-ccc5-48f9-8d10-5d8a0a5cc644 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "swap": 0}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:52.155106 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-e852554b-ccc5-48f9-8d10-5d8a0a5cc644 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462276 Sep 19 11:16:52.159814 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 16/31] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:52.168054 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-f7c6f0a3-5e4b-4b7b-a143-bf3a9d308f06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:52.192477 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-f7c6f0a3-5e4b-4b7b-a143-bf3a9d308f06 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028213 Sep 19 11:16:52.193317 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 16/32] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 11:16:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:16:54.926138 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e852554b-ccc5-48f9-8d10-5d8a0a5cc644 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:54.927064 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-e852554b-ccc5-48f9-8d10-5d8a0a5cc644 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 19 11:16:54.927682 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 17/33] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:55.371516 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-c42d1a97-20a6-4144-88a2-56d268824be6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:55.378660 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:55.395246 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-c42d1a97-20a6-4144-88a2-56d268824be6 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461230 Sep 19 11:16:55.395832 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 17/34] 10.222.0.81 () {64 vars in 1283 bytes} [Mon Sep 19 11:16:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:16:55.408415 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-2c1057d6-99cd-4a4a-a993-5cc4cf29d2d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:16:55.434936 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-2c1057d6-99cd-4a4a-a993-5cc4cf29d2d2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030498 Sep 19 11:16:55.435554 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 18/35] 10.222.0.81 () {64 vars in 1333 bytes} [Mon Sep 19 11:16:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:11.337929 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-c42d1a97-20a6-4144-88a2-56d268824be6 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:11.338860 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-c42d1a97-20a6-4144-88a2-56d268824be6 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 19 11:17:11.339426 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 18/36] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:17:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:11.350214 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:11.727857 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-4717d743-8b54-4f5a-8a0e-c891621bc8e1 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:11.746219 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-4717d743-8b54-4f5a-8a0e-c891621bc8e1 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400490 Sep 19 11:17:11.746762 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 19/37] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 11:17:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:17:13.064185 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-c42d1a97-20a6-4144-88a2-56d268824be6 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:13.065967 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-c42d1a97-20a6-4144-88a2-56d268824be6 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Sep 19 11:17:13.066659 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 19/38] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:13.588617 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e6503920-4871-4939-bb4f-f4a7c1047a37 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:13.593801 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.wsgi [None req-e6503920-4871-4939-bb4f-f4a7c1047a37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e6503920-4871-4939-bb4f-f4a7c1047a37 admin admin] Request method failure captured: Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Accept: application/json Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Accept-Encoding: gzip, deflate Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Connection: keep-alive Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Content-Length: 0 Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Host: 10.222.0.81 Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Openstack-Api-Version: compute 2.92 Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Openstack-System-Scope: None Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: User-Agent: python-novaclient Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Auth-Token: gAAAAABjKE-4xRymQ9T9edXEQstScLyCzczpu-F1jaLxvdR30PIsAFwwv5U-PnHSOLdjrhkDpBwyfycvPkUyyZVI0VMNDnNso0HcfxNzVAgqNi3fumn7C1ti3OgP0ABmp_6bEOo7u7FbtdBGM4i5BQfPUC6TMRPWwreRaZXzwvNCmang9Y8bHyA Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Domain-Id: None Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Domain-Name: None Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Identity-Status: Confirmed Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Is-Admin-Project: True Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Domain-Id: default Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Domain-Name: Default Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Name: admin Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Role: admin,reader,member Sep 19 11:17:13.597008 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Roles: admin,reader,member Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d5c1387f77e4df7ac9b4d83d404bc68", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}] Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant: admin Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant-Name: admin Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User: admin Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Domain-Id: default Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Domain-Name: Default Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Id: dd316848081f4ae2ab8647785189b3f8 Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Name: admin Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: method: > Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: exception: Flavor 42 could not be found. Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: action_args: {'id': '42'} Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:17:13.598655 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:13.599681 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.601003 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e6503920-4871-4939-bb4f-f4a7c1047a37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105469) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:17:13.602259 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-e6503920-4871-4939-bb4f-f4a7c1047a37 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.393464 Sep 19 11:17:13.602259 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 20/39] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 11:17:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 11:17:13.608073 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-5d9479b6-94f5-43a1-8227-3edd55a98bb4 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:13.630918 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-5d9479b6-94f5-43a1-8227-3edd55a98bb4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026354 Sep 19 11:17:13.631462 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 20/40] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 11:17:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:17:13.642134 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-fa39c1c6-fe4e-43bb-8b59-1cb95007d5f5 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:13.664172 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-fa39c1c6-fe4e-43bb-8b59-1cb95007d5f5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026357 Sep 19 11:17:13.664719 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 21/41] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 11:17:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:17:13.674870 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-cdd9cb7f-fca8-423d-badc-85795365ec56 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:13.680227 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.wsgi [None req-cdd9cb7f-fca8-423d-badc-85795365ec56 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-cdd9cb7f-fca8-423d-badc-85795365ec56 admin admin] Request method failure captured: Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Accept: application/json Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Accept-Encoding: gzip, deflate Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Connection: keep-alive Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Content-Length: 0 Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Host: 10.222.0.81 Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Openstack-Api-Version: compute 2.92 Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Openstack-System-Scope: None Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: User-Agent: python-novaclient Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Auth-Token: gAAAAABjKE-4xRymQ9T9edXEQstScLyCzczpu-F1jaLxvdR30PIsAFwwv5U-PnHSOLdjrhkDpBwyfycvPkUyyZVI0VMNDnNso0HcfxNzVAgqNi3fumn7C1ti3OgP0ABmp_6bEOo7u7FbtdBGM4i5BQfPUC6TMRPWwreRaZXzwvNCmang9Y8bHyA Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Domain-Id: None Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Domain-Name: None Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Identity-Status: Confirmed Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Is-Admin-Project: True Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Domain-Id: default Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Domain-Name: Default Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Name: admin Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Role: admin,reader,member Sep 19 11:17:13.683587 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Roles: admin,reader,member Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d5c1387f77e4df7ac9b4d83d404bc68", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}] Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant: admin Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant-Name: admin Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User: admin Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Domain-Id: default Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Domain-Name: Default Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Id: dd316848081f4ae2ab8647785189b3f8 Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Name: admin Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: method: > Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: exception: Flavor 42 could not be found. Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: action_args: {'id': '42'} Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:17:13.685157 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:13.686200 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:13.687566 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-cdd9cb7f-fca8-423d-badc-85795365ec56 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:17:13.688847 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-cdd9cb7f-fca8-423d-badc-85795365ec56 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014695 Sep 19 11:17:13.688847 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 21/42] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 11:17:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:14.887181 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-fa39c1c6-fe4e-43bb-8b59-1cb95007d5f5 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:14.888230 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-fa39c1c6-fe4e-43bb-8b59-1cb95007d5f5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 19 11:17:14.888633 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 22/43] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:15.419222 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-269287dc-fcef-41f3-a606-437461553fd9 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:15.424760 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.wsgi [None req-269287dc-fcef-41f3-a606-437461553fd9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-269287dc-fcef-41f3-a606-437461553fd9 admin admin] Request method failure captured: Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Accept: application/json Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Accept-Encoding: gzip, deflate Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Connection: keep-alive Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Content-Length: 0 Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Host: 10.222.0.81 Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Openstack-Api-Version: compute 2.92 Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Openstack-System-Scope: None Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: User-Agent: python-novaclient Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Auth-Token: gAAAAABjKE-6pzqSyYirXQgfsw0JBI9N8JmiU9E8SnNN5qR-FdvlgxRmleGBtZajKitSjSsfGuVVV3q0MB2jGjpMO0f_T0DZglPDmJYNk4c0IYVbrDL9_pAGqUC8geKDM4NzzDqnmNtXLoCy5P225hWiAlTXMx6nIaVnfj1kwkPaZeY8q3poV_c Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Domain-Id: None Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Domain-Name: None Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Identity-Status: Confirmed Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Is-Admin-Project: True Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Domain-Id: default Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Domain-Name: Default Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Name: admin Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Role: admin,reader,member Sep 19 11:17:15.426251 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Roles: admin,reader,member Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d5c1387f77e4df7ac9b4d83d404bc68", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}] Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant: admin Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant-Name: admin Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User: admin Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Domain-Id: default Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Domain-Name: Default Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Id: dd316848081f4ae2ab8647785189b3f8 Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Name: admin Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: method: > Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: exception: Flavor 84 could not be found. Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: action_args: {'id': '84'} Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:17:15.427729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:15.428673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.429950 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-269287dc-fcef-41f3-a606-437461553fd9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:17:15.431176 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-269287dc-fcef-41f3-a606-437461553fd9 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398877 Sep 19 11:17:15.431176 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 22/44] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 11:17:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:15.437393 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-65dd7749-3c41-4abe-9fa9-b12d7343bdcc admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:15.452959 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-65dd7749-3c41-4abe-9fa9-b12d7343bdcc admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019194 Sep 19 11:17:15.453497 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 23/45] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 11:17:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:17:15.462711 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-ae94b606-3f5a-4685-9259-552cf32a0320 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:15.477673 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-ae94b606-3f5a-4685-9259-552cf32a0320 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018359 Sep 19 11:17:15.478193 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 23/46] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 11:17:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:17:15.487611 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e9ff526b-c168-4e61-a59d-0341e63c1e5f admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:15.492448 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.wsgi [None req-e9ff526b-c168-4e61-a59d-0341e63c1e5f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e9ff526b-c168-4e61-a59d-0341e63c1e5f admin admin] Request method failure captured: Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Accept: application/json Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Accept-Encoding: gzip, deflate Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Connection: keep-alive Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Content-Length: 0 Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Host: 10.222.0.81 Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Openstack-Api-Version: compute 2.92 Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Openstack-System-Scope: None Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: User-Agent: python-novaclient Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Auth-Token: gAAAAABjKE-6pzqSyYirXQgfsw0JBI9N8JmiU9E8SnNN5qR-FdvlgxRmleGBtZajKitSjSsfGuVVV3q0MB2jGjpMO0f_T0DZglPDmJYNk4c0IYVbrDL9_pAGqUC8geKDM4NzzDqnmNtXLoCy5P225hWiAlTXMx6nIaVnfj1kwkPaZeY8q3poV_c Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Domain-Id: None Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Domain-Name: None Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Identity-Status: Confirmed Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Is-Admin-Project: True Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Domain-Id: default Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Domain-Name: Default Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Name: admin Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Role: admin,reader,member Sep 19 11:17:15.493920 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Roles: admin,reader,member Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d5c1387f77e4df7ac9b4d83d404bc68", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}] Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant: admin Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant-Name: admin Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User: admin Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Domain-Id: default Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Domain-Name: Default Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Id: dd316848081f4ae2ab8647785189b3f8 Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Name: admin Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: method: > Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: exception: Flavor 84 could not be found. Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: action_args: {'id': '84'} Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:17:15.495590 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:15.496808 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:15.498256 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-e9ff526b-c168-4e61-a59d-0341e63c1e5f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105469) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:17:15.499541 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-e9ff526b-c168-4e61-a59d-0341e63c1e5f admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011615 Sep 19 11:17:15.499541 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 24/47] 10.222.0.81 () {60 vars in 1190 bytes} [Mon Sep 19 11:17:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:16.739425 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-ae94b606-3f5a-4685-9259-552cf32a0320 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:16.740465 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-ae94b606-3f5a-4685-9259-552cf32a0320 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 19 11:17:16.740863 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 24/48] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:17.267102 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-3794561b-68ea-4854-827c-91ed2e986048 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:17.273358 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.wsgi [None req-3794561b-68ea-4854-827c-91ed2e986048 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-3794561b-68ea-4854-827c-91ed2e986048 admin admin] Request method failure captured: Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Accept: application/json Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Accept-Encoding: gzip, deflate Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Connection: keep-alive Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Content-Length: 0 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Host: 10.222.0.81 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Openstack-Api-Version: compute 2.92 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Openstack-System-Scope: None Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: User-Agent: python-novaclient Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Auth-Token: gAAAAABjKE-8nMPewql8YwCNh6kUKh3XOj1UZgrPGtOLS4_jrGVqJ4R_WelDDgos5SXWG2tfjOO_OyquYtm8NCSkdWItlEeNWMD14WQj_fJTnT21295hhuzvZZ7lSoxjuHyZJOpYgAOJkPkC8Ryn4i-wZkNeT4KWKAQZkQ92htsRtYgQcaERQh0 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Domain-Id: None Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Domain-Name: None Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Identity-Status: Confirmed Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Is-Admin-Project: True Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Domain-Id: default Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Domain-Name: Default Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Project-Name: admin Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Role: admin,reader,member Sep 19 11:17:17.274854 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Roles: admin,reader,member Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d5c1387f77e4df7ac9b4d83d404bc68", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}] Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant: admin Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-Tenant-Name: admin Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User: admin Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Domain-Id: default Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Domain-Name: Default Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Id: dd316848081f4ae2ab8647785189b3f8 Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: X-User-Name: admin Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: method: > Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: exception: Flavor 451 could not be found. Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: action_args: {'id': '451'} Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:17:17.276452 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:17.277430 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.278705 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-3794561b-68ea-4854-827c-91ed2e986048 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105469) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:17:17.280029 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-3794561b-68ea-4854-827c-91ed2e986048 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397759 Sep 19 11:17:17.280029 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 25/49] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 11:17:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 11:17:17.286505 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-369f5368-1224-4789-bb58-2a10bf1ad2d9 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:17.301350 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-369f5368-1224-4789-bb58-2a10bf1ad2d9 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018905 Sep 19 11:17:17.301897 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 25/50] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 11:17:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:17:17.311107 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:17.326081 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018437 Sep 19 11:17:17.326605 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 26/51] 10.222.0.81 () {60 vars in 1210 bytes} [Mon Sep 19 11:17:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:17:17.336109 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-5cfb1007-1bf6-461f-896b-4beb1439f4c5 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:17.341046 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.wsgi [None req-5cfb1007-1bf6-461f-896b-4beb1439f4c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-5cfb1007-1bf6-461f-896b-4beb1439f4c5 admin admin] Request method failure captured: Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Accept: application/json Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Accept-Encoding: gzip, deflate Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Connection: keep-alive Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Content-Length: 0 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Host: 10.222.0.81 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Openstack-Api-Version: compute 2.92 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Openstack-System-Scope: None Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: User-Agent: python-novaclient Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Auth-Token: gAAAAABjKE-8nMPewql8YwCNh6kUKh3XOj1UZgrPGtOLS4_jrGVqJ4R_WelDDgos5SXWG2tfjOO_OyquYtm8NCSkdWItlEeNWMD14WQj_fJTnT21295hhuzvZZ7lSoxjuHyZJOpYgAOJkPkC8Ryn4i-wZkNeT4KWKAQZkQ92htsRtYgQcaERQh0 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Domain-Id: None Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Domain-Name: None Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Identity-Status: Confirmed Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Is-Admin-Project: True Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Domain-Id: default Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Domain-Name: Default Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Project-Name: admin Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Role: admin,reader,member Sep 19 11:17:17.342536 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Roles: admin,reader,member Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5d5c1387f77e4df7ac9b4d83d404bc68", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5d5c1387f77e4df7ac9b4d83d404bc68"}]}] Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant: admin Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant-Id: 5d5c1387f77e4df7ac9b4d83d404bc68 Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-Tenant-Name: admin Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User: admin Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Domain-Id: default Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Domain-Name: Default Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Id: dd316848081f4ae2ab8647785189b3f8 Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: X-User-Name: admin Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: method: > Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: exception: Flavor 451 could not be found. Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: action_args: {'id': '451'} Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:17:17.344373 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:17.345943 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: ERROR nova.api.openstack.wsgi Sep 19 11:17:17.347790 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-5cfb1007-1bf6-461f-896b-4beb1439f4c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:17:17.348999 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-5cfb1007-1bf6-461f-896b-4beb1439f4c5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011242 Sep 19 11:17:17.348999 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 26/52] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 11:17:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:18.558259 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:18.559265 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 19 11:17:18.559664 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 27/53] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:19.078724 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-0852433d-7b38-40ed-96b4-9cc31a68c108 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:19.098992 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-0852433d-7b38-40ed-96b4-9cc31a68c108 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403521 Sep 19 11:17:19.099537 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 27/54] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 11:17:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:20.314183 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:20.315239 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 19 11:17:20.315719 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 28/55] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:20.833887 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-f642aca8-88fb-4993-bcc8-2f8ecde6a915 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:20.852843 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-f642aca8-88fb-4993-bcc8-2f8ecde6a915 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400897 Sep 19 11:17:20.853457 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 28/56] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 11:17:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:22.077032 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:22.078071 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 19 11:17:22.078468 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 29/57] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:22.592280 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-2b353af7-5107-4357-ac24-8b566edd50f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:22.610285 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-2b353af7-5107-4357-ac24-8b566edd50f0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395998 Sep 19 11:17:22.610818 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 29/58] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 11:17:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:23.833851 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:23.834891 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 19 11:17:23.835296 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 30/59] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:24.356320 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-58fe9b30-4feb-4d8b-8916-152b35a34b4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:24.374830 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-58fe9b30-4feb-4d8b-8916-152b35a34b4b admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.404075 Sep 19 11:17:24.375390 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 30/60] 10.222.0.81 () {64 vars in 1235 bytes} [Mon Sep 19 11:17:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:25.587420 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:25.588450 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 19 11:17:25.588857 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 31/61] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:17:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:26.106138 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-8a14c98b-55fd-45f7-aee6-2c006facbc73 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:26.126407 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-8a14c98b-55fd-45f7-aee6-2c006facbc73 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400750 Sep 19 11:17:26.126956 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 31/62] 10.222.0.81 () {60 vars in 1202 bytes} [Mon Sep 19 11:17:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:22.710269 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:22.711288 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-ee756833-d69a-4b0e-a863-47103aaef0d0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 19 11:18:22.711694 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 32/63] 10.222.0.81 () {54 vars in 931 bytes} [Mon Sep 19 11:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:22.722189 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:23.098894 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-7e49dd00-c93f-4226-864b-9b2a4240d964 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:23.120185 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-7e49dd00-c93f-4226-864b-9b2a4240d964 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402429 Sep 19 11:18:23.120721 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 32/64] 10.222.0.81 () {60 vars in 1292 bytes} [Mon Sep 19 11:18:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:23.141212 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_api:SELECT=14 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:23.145243 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-9a0bd7b8-abb6-4e92-94b9-a395ef931e77 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:23.152687 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-9a0bd7b8-abb6-4e92-94b9-a395ef931e77 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012989 Sep 19 11:18:23.153214 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 33/65] 10.222.0.81 () {60 vars in 1283 bytes} [Mon Sep 19 11:18:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:18:23.165130 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-b260bc1c-6541-43b6-8bf9-2169d5d74d97 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:23.172481 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-b260bc1c-6541-43b6-8bf9-2169d5d74d97 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011477 Sep 19 11:18:23.172977 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 33/66] 10.222.0.81 () {60 vars in 1286 bytes} [Mon Sep 19 11:18:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:18:23.184660 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:23.191608 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010476 Sep 19 11:18:23.192153 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 34/67] 10.222.0.81 () {60 vars in 1286 bytes} [Mon Sep 19 11:18:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:18:23.203290 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-aa0d1e1e-2d86-4c8b-8382-1b653c0699c8 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:23.210256 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-aa0d1e1e-2d86-4c8b-8382-1b653c0699c8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010685 Sep 19 11:18:23.210760 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 34/68] 10.222.0.81 () {60 vars in 1283 bytes} [Mon Sep 19 11:18:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:21:25.611859 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:25.612901 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 19 11:21:25.613312 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 35/69] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:21:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:21:25.757469 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_api:SELECT=6 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:25.920499 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:25.925183 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:25.925651 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:25.926080 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:25.926788 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:25.927241 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:25.927658 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:25.959180 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-a96944a8-a5c9-4765-9888-c59b62666a38 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.202971 Sep 19 11:21:25.959729 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 35/70] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 11:21:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:21:27.042060 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:27.043099 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Sep 19 11:21:27.043502 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 36/71] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:21:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:21:27.232951 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:27.236301 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:27.236768 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:27.237183 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:27.237881 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:27.238317 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:27.238726 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:27.257537 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-482f8b2b-4ffb-4377-89ca-19e1884f192a admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076370 Sep 19 11:21:27.258067 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 36/72] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 11:21:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:21:38.715027 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:38.716098 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 19 11:21:38.716490 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 37/73] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:21:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:21:38.862234 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_cell0:SELECT=4 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:38.863288 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_cell1:SELECT=4 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:38.864267 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG dbcounter [-] [105470] Writing DB stats nova_api:SELECT=8 {{(pid=105470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:38.913762 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:38.917182 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:38.917648 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:38.918071 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:38.918805 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:38.919248 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:38.919664 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:38.944872 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-e9392d35-e399-4132-8e18-b40e9b50b1d0 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.089309 Sep 19 11:21:38.945357 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 37/74] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 11:21:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:21:40.019965 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG nova.api.openstack.wsgi [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] Calling method '>' {{(pid=105469) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:40.020975 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: INFO nova.api.openstack.requestlog [None req-12e3fa82-484b-4208-b2b4-986a2ac11047 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 19 11:21:40.021376 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: [pid: 105469|app: 0|req: 38/75] 10.222.0.81 () {56 vars in 1074 bytes} [Mon Sep 19 11:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:21:40.210987 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG nova.api.openstack.wsgi [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Calling method '>' {{(pid=105470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:21:40.214872 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:40.215334 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:40.215752 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:40.216466 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:21:40.216900 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:21:40.217305 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: DEBUG oslo_concurrency.lockutils [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:21:40.238387 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: INFO nova.api.openstack.requestlog [None req-35548686-8c82-4c99-9761-fd854a67b795 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.077840 Sep 19 11:21:40.238863 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: [pid: 105470|app: 0|req: 38/76] 10.222.0.81 () {60 vars in 1193 bytes} [Mon Sep 19 11:21:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:22:38.134754 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: Mon Sep 19 11:22:38 2022 - graceful shutdown triggered... Sep 19 11:22:38.135386 dv-cinder-820994-5-iscsi devstack@n-api.service[105470]: Gracefully killing worker 2 (pid: 105470)... Sep 19 11:22:38.135172 dv-cinder-820994-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 11:22:38.136372 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: Gracefully killing worker 1 (pid: 105469)... Sep 19 11:22:38.294282 dv-cinder-820994-5-iscsi devstack@n-api.service[105469]: DEBUG dbcounter [-] [105469] Writing DB stats nova_api:SELECT=4 {{(pid=105469) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:39.135904 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: worker 1 buried after 1 seconds Sep 19 11:22:39.136407 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: worker 2 buried after 1 seconds Sep 19 11:22:39.136407 dv-cinder-820994-5-iscsi devstack@n-api.service[105468]: goodbye to uWSGI. Sep 19 11:22:39.137484 dv-cinder-820994-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 11:22:39.138023 dv-cinder-820994-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 11:22:39.140940 dv-cinder-820994-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 11:22:39.151715 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:22:39 2022] *** Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: nodename: dv-cinder-820994-5-iscsi Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: machine: x86_64 Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: clock source: unix Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: pcre jit disabled Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: detected number of CPU cores: 4 Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: current working directory: / Sep 19 11:22:39.154279 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: your processes number limit is 47680 Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: your memory page size is 4096 bytes Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: detected max file descriptor number: 2048 Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: lock engine: pthread robust mutexes Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: thunder lock: enabled Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 11:22:39.155018 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:22:39.201300 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: Python main interpreter initialized at 0x5586f35459c0 Sep 19 11:22:39.201300 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: python threads support enabled Sep 19 11:22:39.201300 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: your server socket listen backlog is limited to 100 connections Sep 19 11:22:39.201300 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:22:39.201763 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:22:39.201876 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: *** Operational MODE: preforking *** Sep 19 11:22:39.202166 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:22:39.202166 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: spawned uWSGI master process (pid: 120445) Sep 19 11:22:39.204608 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: spawned uWSGI worker 1 (pid: 120458, cores: 1) Sep 19 11:22:39.204608 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: spawned uWSGI worker 2 (pid: 120459, cores: 1) Sep 19 11:22:39.204608 dv-cinder-820994-5-iscsi devstack@n-api.service[120445]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:22:39.202374 dv-cinder-820994-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 11:22:39.884821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:22:39.908480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:22:41.093280 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:22:41.093280 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: from cryptography.utils import int_from_bytes Sep 19 11:22:41.093903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:22:41.093903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: from cryptography.utils import int_from_bytes Sep 19 11:22:41.225491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:22:41.225491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: from cryptography.utils import int_from_bytes Sep 19 11:22:41.226112 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:22:41.226112 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: from cryptography.utils import int_from_bytes Sep 19 11:22:43.830048 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:22:43.830694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:22:43.830992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:22:43.831218 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:22:43.831482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:22:43.831903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.832240 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.832576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.832899 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.833237 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.833555 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.834146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.834472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.834806 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.835071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.835391 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.835898 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-5-iscsi {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.836237 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.836558 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.836882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.837212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.837525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.837856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.838171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.838680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.844669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-5-iscsi {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845901 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.845980 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:22:43.846386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.846864 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:22:43.846950 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.846950 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.847102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:22:43.847181 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.847261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:22:43.847346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.847424 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:22:43.847496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.847572 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.847648 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.847733 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848517 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848825 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.848970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.849125 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.849277 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.849429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.849574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.849574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.849871 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850217 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850538 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850685 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.850986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.851139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-5-iscsi {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.851284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.851442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.851602 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.851803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.851957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.852101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.852255 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.852411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.852582 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.853258 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.853460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.853611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.853769 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.853914 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854057 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854057 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854831 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.854975 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.855118 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.855266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.855864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.856106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.856265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.856416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.856617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.858510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.858690 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.858862 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859021 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.859942 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-5-iscsi {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860845 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.860998 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.861142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.861299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.861452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.861596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.861778 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.861925 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.862079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.862270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.862428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.862579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.862731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.862930 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.863097 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.864624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.864820 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.864981 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.865137 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.865292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.865453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.865622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.865991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.866143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.866297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.866462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.866697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.866866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.867272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.867586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.867741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.867936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868379 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.868951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.869247 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.869401 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.869552 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.869708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.869868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.870019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.870165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.870314 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.870466 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.870619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.871277 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.871444 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.871600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.871751 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.871920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872079 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872831 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.872988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873311 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873771 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.873922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.874209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.874362 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.874506 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.874506 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.874787 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.874787 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.875078 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.875232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.875382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.875382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.875660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.875850 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.876204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.876364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.876510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.876661 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.876856 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.877001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.877387 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.877644 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.877898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.878060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.878205 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.878348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.878501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.878652 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.878816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.879045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.879202 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.879357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.879502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.879655 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.879869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880500 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880500 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880771 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.880928 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881236 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881540 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881684 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881844 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.881990 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.882146 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.882290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.882439 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.882589 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.882740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.882884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.883044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.883193 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.883345 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.883496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.883650 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.883833 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.883991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.884146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.884291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.884607 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.884777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.884936 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.885094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.885251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.885402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.885402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.885683 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.885836 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.885998 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.886360 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.887144 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.887516 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.887811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.888062 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.888227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.888374 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.888519 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.888671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.888824 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.888969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.889224 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.889392 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.889545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.889696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.889847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.889991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.890134 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.890900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.891065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.891221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.891377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.891523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.891667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.891923 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.892087 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.892240 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.892384 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.892534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.892957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.893126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.893275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.893417 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.893417 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.893690 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.893842 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.893986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.894344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.894507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.894653 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.894797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.894948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.895100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.895244 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.895394 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.895545 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.895690 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.895881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.896038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.896182 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.896563 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.896722 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.896868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.897026 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.897239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.897628 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.897802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.898019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.898019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.898409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.898569 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.898721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.898885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.899069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.899324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:22:43.899479 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.899646 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.899822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.899990 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.900136 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.900136 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.900434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.900434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.900717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.900717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901002 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901304 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901304 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.901868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.902164 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.902323 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.902477 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.902629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.902773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.902925 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903401 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903551 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903703 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903899 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.903899 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.904306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.904469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.904623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.904775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.904926 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905240 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905818 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.905818 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.906113 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.906113 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.906711 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.906880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.907035 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.907225 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.907384 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.907835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.908026 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.908263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.908507 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.908666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.908819 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.908964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.909106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.909251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.909428 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.909669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.909819 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.909981 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.910135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.910280 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.910433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.910578 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.910729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.910873 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.911067 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.911225 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.911372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.911514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.911657 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.911840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912010 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912164 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912604 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.912954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.913108 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.913268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.913424 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.913570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.913712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.913872 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.914025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.914169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.914312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.915227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.915397 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.915546 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.915698 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.915869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.916025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.916179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.916325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.916480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.916868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.917021 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.917172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.917374 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.917525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.917972 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.918125 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.918285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.918545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.918801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.918953 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.919104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.919260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.919410 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.919570 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.919841 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.919996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.920141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.920302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.920455 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.920683 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.920831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.920975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.921126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.921281 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.921454 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.921612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.921796 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.921950 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.922094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.922245 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.922399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.922552 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.922704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.922855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.923008 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.923158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.923493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.923493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.923833 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924002 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924750 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.924900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.925046 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.925198 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.925352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.925508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.925652 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.925795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.926169 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.926335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.926489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.926642 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.927027 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.927387 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.927546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.927701 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928905 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.928989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929619 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929824 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.929911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930003 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930456 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930725 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.930992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931085 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931255 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931593 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931908 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.931995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932079 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932170 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932263 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932440 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932608 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932804 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.932982 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.933065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.933147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.934212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.934781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.934888 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.934984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935248 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935538 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935722 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.935928 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936279 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936542 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936625 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936716 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.936909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937164 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937345 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937446 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937533 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937627 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937878 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.937969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938078 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938657 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938750 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938836 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.938909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.939663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.939840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.939944 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940229 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940746 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940842 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.940935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941385 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941569 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941830 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.941923 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942009 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942460 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942728 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.942908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943008 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943690 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943865 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.943936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944032 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944567 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944748 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944832 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.944923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945450 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945547 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.945976 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946160 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946245 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946448 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946582 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946582 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946830 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.946925 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947125 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947295 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947636 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947721 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.947919 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948014 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948279 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948776 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.948909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.949646 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.949744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.949744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.949916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.949916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950298 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950437 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950634 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950720 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950720 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.950987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951164 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951263 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951612 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951704 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.951985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952079 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952206 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952396 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.952876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.953218 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.953541 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.953788 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.953959 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.954224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.954392 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.954554 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.954719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.954878 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.955037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.955197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.955361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.955525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.955677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.955862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956649 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.956982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.957142 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.957301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.957469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.957622 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.957773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.957931 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.958083 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.958233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.958383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.958534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.958695 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.959106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.959260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.959410 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.959721 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.959908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.960073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.960241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.960407 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.960574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.960710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.960841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961021 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961189 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.961968 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.962119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.962277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.962428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.962587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.962747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.962911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.963063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.963230 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.963382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.963531 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.963682 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.964291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.964480 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.964646 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.964800 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.964951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.965115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.965355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.965507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.965664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.965830 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.965990 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966156 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966935 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.966935 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.967231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.967381 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.967531 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.967698 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.968006 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.968173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.968324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.968481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.968639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.968789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.969017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.969179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.969338 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.969495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.969653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.969968 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.970143 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.970303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.970462 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.970621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.970778 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.970936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.971097 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.971257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.971416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.971566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.971715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.971947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972139 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972792 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.972979 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973435 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.973980 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974167 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974444 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974865 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.974972 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.975184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.975288 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.975505 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.975600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.975838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.975938 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.976152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.976256 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.976474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.976574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.976792 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.976893 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.977097 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.977197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.977411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.977511 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.977718 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.977819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978026 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978128 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978646 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.978951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979369 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979564 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979665 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.979995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.980794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.980989 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.981163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.981329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.981482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.981632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.981632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.982263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.982425 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.982584 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.982737 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.982888 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.982888 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.983185 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.983337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.983495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.983657 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.983834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.984002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.984161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.984313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.984610 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.984785 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.984939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.985099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.985250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.985400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.985557 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.985726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.985886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.986996 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.987154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.987305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.987462 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.987613 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.987806 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.987966 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.988116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.988266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.988417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.988566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.988729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.988881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.989041 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.989192 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.989341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.989492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.989492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.989802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.990097 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.990256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.990415 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.990574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.990746 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.990927 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.991174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.991332 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.991491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.991652 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.991849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992008 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992347 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992506 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.992980 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.993139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.993292 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.993449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.993613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994169 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994785 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.994943 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.995095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.995246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.995395 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.995559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.995773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.996447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.996602 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.996762 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.996924 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.997085 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.997237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.997395 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.997552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.997712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.997864 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.998148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.998330 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.998500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.998666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.998826 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.998986 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.999155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.999315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.999469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.999619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.999795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:43.999971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.000260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.000418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.000570 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.000731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.000884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.001046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.001221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.001397 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.001550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.001700 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.001851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002015 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002015 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002637 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.002946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.003095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.003264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.003415 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.003575 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.003734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.003923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004484 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.004986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.005288 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.005288 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.005606 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.005766 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.005917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.005917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.006212 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.006372 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.006524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.006675 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.006826 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.006976 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.007126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.007285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.007454 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.007606 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.007818 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.007989 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.008143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.008312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.008471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.008623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.008781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.008933 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.009092 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.009256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.009408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.009571 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.009731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.009889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.010050 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.010343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.010505 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.010673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.010827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.011015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.011183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.011385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.011623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.011938 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.012199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.012412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.012640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.012923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.013155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.013371 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.013609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.013803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.013964 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.014117 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.014276 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.014429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.014592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.014592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.014592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.015032 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.015190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.015342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.015511 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.015673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.015864 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016021 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016471 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.016953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.017114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.017266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.017427 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.017578 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.017728 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.017886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.018045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.018203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.018364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.018533 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.018693 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.018843 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019158 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019811 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.019970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.020131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.020464 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.020642 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.020818 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.020971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.021122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.021287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.021448 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.021601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.021752 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.021902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022053 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022839 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.022990 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.023149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.023301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.023579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.023579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.023926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.024090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.024242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.024393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.024562 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.024715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.024877 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025042 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025195 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025346 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025503 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.025983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.026142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.026300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.026453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.026611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.026771 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.026973 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.027133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.027292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.027452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.027603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.027603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.027603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.028086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.028239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.028403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.028564 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.028723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.028876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029036 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029487 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029684 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029838 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.029997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.030155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.030313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.030630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.030630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.031292 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.031446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.031627 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.031800 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.031971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.032131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.032283 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.032432 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.032589 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.032749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.032909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.033063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.033213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.033364 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.033532 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.033692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.033852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034004 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034625 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034784 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.034945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.035097 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.035246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.035417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.035582 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.035733 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.035944 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.036096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.036096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.036382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.036544 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.036696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.036853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.037011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.037163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.037411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.037574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.037725 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.037874 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038189 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038508 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038825 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.038983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.039134 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.039293 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.039293 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.039606 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.039757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.039933 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.040095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.040247 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.040247 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.040539 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.040838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041004 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041004 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041477 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.041947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.042107 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.042259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.042410 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.043093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.043261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.043422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.043575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.043734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.043947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.044109 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.044267 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.044428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.044580 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.044738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.044896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.045055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.045205 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.045437 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.045599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.045751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.045900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.046075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.046241 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.046393 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.046552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.046754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.046905 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.047055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.047220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.047382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.047532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.047532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.047837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048647 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048804 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.048964 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.049122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.049274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.049431 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.049583 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.049741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.049901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.050063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.050290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.050454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.050606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.050904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.051088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.051242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.051392 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.051549 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.051549 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.051869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052826 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.052826 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.053114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.053271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.053429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.053588 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.053747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.053898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.054056 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.054224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.054376 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.054534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.054694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.054852 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055013 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055013 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055799 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.055967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.056120 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.056285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.056444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.056596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.056745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.056894 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057043 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057659 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.057808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.058101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.058836 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059802 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.059962 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.060122 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.060275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.060425 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.060588 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.060756 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061217 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061841 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.061991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.062140 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.062290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.062447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.062607 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.062758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.062920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.063071 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.063071 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.063366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.063531 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.063682 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.063919 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.064073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.064234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.064400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.064552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.064552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.064852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065491 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065641 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.065798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.066100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.066261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.066419 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.066419 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.066714 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.066864 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.067031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.067031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.067339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.067339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.067626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.067839 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.068957 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.069117 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.069268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.069417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.069567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.069718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.069882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.070034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.070191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.070350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.070508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.070668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.070821 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.071012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.071305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.071457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.071614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.071794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.071954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.072105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.072255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.072416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.072574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.072738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.072892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.073053 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.073214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.073366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.073515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.073679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.074119 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.074296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.074457 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.074618 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.074784 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.074939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.075088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.075239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.075408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.075561 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.075840 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076014 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076327 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.076942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.077239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.077390 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.077559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.077727 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.077880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078181 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.078979 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.079139 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.079297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.079467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.079633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.079803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.079962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.080123 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.080278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.080437 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.080589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.080739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.080889 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.081047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.081351 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.081521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.081686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.081838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.081988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.082139 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.082291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.082454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.082614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.082766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.082918 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.083068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.083218 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.083382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.083548 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.083699 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.084122 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.084275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.084462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.084749 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.084749 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.085081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.085235 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.085386 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.085546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.085705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.085858 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.086954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.087104 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.087263 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.087422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.087574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.087724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.087920 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.088083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.088255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.088415 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.088567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.088725 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.088882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.089033 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.089193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.089351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.089555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.089723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.089875 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090049 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090210 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090362 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090519 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.090979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.091897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092688 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.092964 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093240 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093334 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093421 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093520 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093608 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093787 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093875 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.093969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094706 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.094873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095879 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.095969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.096120 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.096300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.096495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.096665 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.096828 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.096988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.097193 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.097393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.097548 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.097708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.097873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.098026 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.098189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.098341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.098528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.098692 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.098853 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.099005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.099155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.099305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.099488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.099654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.099912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.100029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.100127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.100430 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.100629 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.100797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.100949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.101099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.101257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.101416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.101582 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.101734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.102049 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.102220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.102380 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.102537 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.102702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.102853 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.103005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.103163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.103334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.103485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.103717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.103942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.104107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.104269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.104429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.104714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.104903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.105581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.105743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:22:44.105903 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.105903 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.106215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.106375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.106681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.107000 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.107312 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:22:44.107557 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:22:44.169779 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO dbcounter [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Registered counter for database nova_api Sep 19 11:22:44.173507 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO dbcounter [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Registered counter for database nova_api Sep 19 11:22:44.192241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.194359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_db.sqlalchemy.engines [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.199794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writer thread running {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.202243 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writer thread running {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.255871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.context [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c575dc0f-6975-4ee0-be74-9be0c3940462(cell1) {{(pid=120458) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:22:44.259914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:44.260389 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:44.262509 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:44.262761 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.context [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c575dc0f-6975-4ee0-be74-9be0c3940462(cell1) {{(pid=120459) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:22:44.263231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:44.263688 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:44.265728 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:44.267031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:44.267522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:44.267813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO dbcounter [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Registered counter for database nova_cell0 Sep 19 11:22:44.269465 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:44.270276 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:44.270895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:44.272044 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO dbcounter [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Registered counter for database nova_cell1 Sep 19 11:22:44.275645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:44.275645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO dbcounter [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Registered counter for database nova_cell0 Sep 19 11:22:44.280144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO dbcounter [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Registered counter for database nova_cell1 Sep 19 11:22:44.281695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.285948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.287145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_db.sqlalchemy.engines [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.287528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writer thread running {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.290613 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_db.sqlalchemy.engines [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.298147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writer thread running {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.299510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writer thread running {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.429186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writer thread running {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.438485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO dbcounter [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Registered counter for database nova_cell0 Sep 19 11:22:44.445313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_db.sqlalchemy.engines [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.448690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO dbcounter [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Registered counter for database nova_cell0 Sep 19 11:22:44.450215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writer thread running {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.455622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_db.sqlalchemy.engines [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:22:44.460445 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writer thread running {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:22:44.771331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: WARNING keystonemiddleware.auth_token [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:22:44.778705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: WARNING keystonemiddleware.auth_token [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:22:44.784617 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: WARNING keystonemiddleware.auth_token [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:22:44.792091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: WARNING keystonemiddleware.auth_token [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:22:45.122291 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: WARNING keystonemiddleware.auth_token [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:22:45.128314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: WARNING keystonemiddleware.auth_token [None req-ac0e00c1-6852-417d-a844-c901e146d8db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:22:45.133614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586f35459c0 pid: 120458 (default app) Sep 19 11:22:45.146056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: WARNING keystonemiddleware.auth_token [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:22:45.152651 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: WARNING keystonemiddleware.auth_token [None req-1589d981-5d8e-48a3-9a77-54cb920306f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:22:45.158010 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586f35459c0 pid: 120459 (default app) Sep 19 11:23:21.846520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:21.848709 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:21.851591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:21.854096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:23.099521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-27fcef16-e1dd-44a0-8f7e-c910fe6fc2d0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Action: 'create', calling method: .version_select at 0x7ff5226ae4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1682533686", "metadata": {"Type": "work"}}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-27fcef16-e1dd-44a0-8f7e-c910fe6fc2d0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Request method failure captured: Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 122 Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFEpFDyz8ytK_tycRztcA3LLuyFThhWh2L8pzPsf_fA7tJc4F9M6oyl2mI8MNGXSGh78TykddepFxQ48NiF64kAHmWdVsFHrrFrH3rCP_zhSl2GC1vLiogwoCDqDUwspIPflheW3HryJc9JQhEdnEcXDzq_kCM28U50cl6wZy1bhGiA Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:23:23.106483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2894018d1d984b839e5b900a1be2e896", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}] Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: bca0348930b94e289519b645b8ec8458 Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1682533686", "metadata": {"Type": "work"}}} Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:23:23.108252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1682533686', 'metadata': {'Type': 'work'}}}} Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:23:23.109272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:23:23.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:23:23.112345 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:23:23.112345 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.112345 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-27fcef16-e1dd-44a0-8f7e-c910fe6fc2d0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:23:23.113137 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-27fcef16-e1dd-44a0-8f7e-c910fe6fc2d0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.295768 Sep 19 11:23:23.113985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 11:23:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1298 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:23:23.130163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:23.131278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:23.133232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:23.133994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:23.482536 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-30927361-3c96-43cd-b870-5d33b33c7ba0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Action: 'create', calling method: .version_select at 0x7ff5226fb1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-778326802", "metadata": {"Type": "work"}}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-30927361-3c96-43cd-b870-5d33b33c7ba0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Request method failure captured: Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 119 Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFEpFDyz8ytK_tycRztcA3LLuyFThhWh2L8pzPsf_fA7tJc4F9M6oyl2mI8MNGXSGh78TykddepFxQ48NiF64kAHmWdVsFHrrFrH3rCP_zhSl2GC1vLiogwoCDqDUwspIPflheW3HryJc9JQhEdnEcXDzq_kCM28U50cl6wZy1bhGiA Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:23:23.491984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2894018d1d984b839e5b900a1be2e896", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}] Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: bca0348930b94e289519b645b8ec8458 Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-778326802", "metadata": {"Type": "work"}}} Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: Sep 19 11:23:23.493635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-778326802', 'metadata': {'Type': 'work'}}}} Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi '0' Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:23:23.494575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:23:23.496704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:23:23.498289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:23:23.498289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.501037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-30927361-3c96-43cd-b870-5d33b33c7ba0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:23:23.503245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-30927361-3c96-43cd-b870-5d33b33c7ba0 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.383130 Sep 19 11:23:23.504167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 1/2] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 11:23:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:23:23.519370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-88704b41-c43a-48b1-94d2-14db574e99f8 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Action: 'create', calling method: .version_select at 0x7ff5226aedc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1826980735", "metadata": {"Type": "work"}}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-88704b41-c43a-48b1-94d2-14db574e99f8 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Request method failure captured: Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 119 Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFEpFDyz8ytK_tycRztcA3LLuyFThhWh2L8pzPsf_fA7tJc4F9M6oyl2mI8MNGXSGh78TykddepFxQ48NiF64kAHmWdVsFHrrFrH3rCP_zhSl2GC1vLiogwoCDqDUwspIPflheW3HryJc9JQhEdnEcXDzq_kCM28U50cl6wZy1bhGiA Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:23:23.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2894018d1d984b839e5b900a1be2e896", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}] Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: bca0348930b94e289519b645b8ec8458 Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1826980735", "metadata": {"Type": "work"}}} Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:23:23.528348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1826980735', 'metadata': {'Type': 'work'}}}} Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi '' Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:23:23.529318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:23:23.530965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:23:23.533604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:23:23.533604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:23.533604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-88704b41-c43a-48b1-94d2-14db574e99f8 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:23:23.537075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-88704b41-c43a-48b1-94d2-14db574e99f8 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024116 Sep 19 11:23:23.539581 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 2/3] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 11:23:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:23:23.553765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fb626b9a-61a9-4a09-8a3b-75f3f6c28c63 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Calling method '.version_select at 0x7ff5226fbe50>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:24.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-fb626b9a-61a9-4a09-8a3b-75f3f6c28c63 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] HTTP exception thrown: Volume tempest-invalid-1744982456 could not be found. Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fb626b9a-61a9-4a09-8a3b-75f3f6c28c63 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Request method failure captured: Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1744982456 HTTP/1.1 Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFEpFDyz8ytK_tycRztcA3LLuyFThhWh2L8pzPsf_fA7tJc4F9M6oyl2mI8MNGXSGh78TykddepFxQ48NiF64kAHmWdVsFHrrFrH3rCP_zhSl2GC1vLiogwoCDqDUwspIPflheW3HryJc9JQhEdnEcXDzq_kCM28U50cl6wZy1bhGiA Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:23:24.930681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2894018d1d984b839e5b900a1be2e896", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}] Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: bca0348930b94e289519b645b8ec8458 Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Volume tempest-invalid-1744982456 could not be found. Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'tempest-invalid-1744982456'} Sep 19 11:23:24.932359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1744982456 could not be found. (HTTP 404) (Request-ID: req-f1ea9f94-a690-43ff-b7d3-890172406165) Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:24.933173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:23:24.934383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1744982456 could not be found. Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:23:24.935494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1744982456 could not be found. Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1744982456 could not be found. Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fb626b9a-61a9-4a09-8a3b-75f3f6c28c63 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Returning 404 to user: Volume tempest-invalid-1744982456 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-fb626b9a-61a9-4a09-8a3b-75f3f6c28c63 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1744982456" status: 404 len: 99 microversion: 2.1 time: 1.389216 Sep 19 11:23:24.941052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 11:23:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1744982456 => generated 99 bytes in 1391 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:23:24.950349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-007bb35d-68b6-422a-b91e-1e856263705c tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005644 Sep 19 11:23:24.951901 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 3/5] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 11:23:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 11:23:24.962544 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-918270b2-8b04-4d53-b419-936fd69d99c9 tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005203 Sep 19 11:23:24.963035 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 3/6] 10.222.0.81 () {58 vars in 1137 bytes} [Mon Sep 19 11:23:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 11:23:24.974955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1f8c029b-d356-41e4-98a8-122f938af65e tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Calling method '.version_select at 0x7ff522566430>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:25.405289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-1f8c029b-d356-41e4-98a8-122f938af65e tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] HTTP exception thrown: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1f8c029b-d356-41e4-98a8-122f938af65e tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Request method failure captured: Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/os-volumes/d0091740-c44c-4abe-92af-75e83976372d HTTP/1.1 Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFEpFDyz8ytK_tycRztcA3LLuyFThhWh2L8pzPsf_fA7tJc4F9M6oyl2mI8MNGXSGh78TykddepFxQ48NiF64kAHmWdVsFHrrFrH3rCP_zhSl2GC1vLiogwoCDqDUwspIPflheW3HryJc9JQhEdnEcXDzq_kCM28U50cl6wZy1bhGiA Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:23:25.411695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2894018d1d984b839e5b900a1be2e896", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}] Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: bca0348930b94e289519b645b8ec8458 Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'd0091740-c44c-4abe-92af-75e83976372d'} Sep 19 11:23:25.413071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. (HTTP 404) (Request-ID: req-33beb84d-b54d-47ce-a805-45e2bda19d63) Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:25.413883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:23:25.414982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:23:25.417126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. Sep 19 11:23:25.418815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.422039 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1f8c029b-d356-41e4-98a8-122f938af65e tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Returning 404 to user: Volume d0091740-c44c-4abe-92af-75e83976372d could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:23:25.427701 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1f8c029b-d356-41e4-98a8-122f938af65e tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/d0091740-c44c-4abe-92af-75e83976372d" status: 404 len: 109 microversion: 2.1 time: 0.458788 Sep 19 11:23:25.434121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:23:24 2022] DELETE /compute/v2.1/os-volumes/d0091740-c44c-4abe-92af-75e83976372d => generated 109 bytes in 466 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:23:25.440764 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3d07f87b-ec62-451f-b13b-9e3aa77be78b tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Calling method '.version_select at 0x7ff522ed98b0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:25.556799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-3d07f87b-ec62-451f-b13b-9e3aa77be78b tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] HTTP exception thrown: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3d07f87b-ec62-451f-b13b-9e3aa77be78b tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Request method failure captured: Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/os-volumes/617ce110-7780-4f50-b91b-0cda441083fe HTTP/1.1 Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFEpFDyz8ytK_tycRztcA3LLuyFThhWh2L8pzPsf_fA7tJc4F9M6oyl2mI8MNGXSGh78TykddepFxQ48NiF64kAHmWdVsFHrrFrH3rCP_zhSl2GC1vLiogwoCDqDUwspIPflheW3HryJc9JQhEdnEcXDzq_kCM28U50cl6wZy1bhGiA Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:23:25.560229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_2894018d1d984b839e5b900a1be2e896", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/2894018d1d984b839e5b900a1be2e896"}]}] Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 2894018d1d984b839e5b900a1be2e896 Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesNegativeTest-314275954 Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: bca0348930b94e289519b645b8ec8458 Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesNegativeTest-314275954-project Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '617ce110-7780-4f50-b91b-0cda441083fe'} Sep 19 11:23:25.561331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. (HTTP 404) (Request-ID: req-b1b525d3-5ba1-4dd1-9539-7ac24e6b9226) Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:25.562161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:23:25.563126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:23:25.573483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3d07f87b-ec62-451f-b13b-9e3aa77be78b tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] Returning 404 to user: Volume 617ce110-7780-4f50-b91b-0cda441083fe could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3d07f87b-ec62-451f-b13b-9e3aa77be78b tempest-VolumesNegativeTest-314275954 tempest-VolumesNegativeTest-314275954-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/617ce110-7780-4f50-b91b-0cda441083fe" status: 404 len: 109 microversion: 2.1 time: 0.128642 Sep 19 11:23:25.576915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:23:25 2022] GET /compute/v2.1/os-volumes/617ce110-7780-4f50-b91b-0cda441083fe => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:23:35.042040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-195887991", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "networks": [{"uuid": "d68d492e-cdd4-4584-9409-0c6543a346e5"}]}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:35.278477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] validate_networks() for [('d68d492e-cdd4-4584-9409-0c6543a346e5', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:23:39.055571 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:23:39.056259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:23:39.057372 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:23:39.057892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:23:39.059002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:23:39.150459 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:39.150953 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:39.151390 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:39.152154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:39.164043 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:39.166303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:39.260091 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Getting quotas for project 8fd848b22f854563a0ab63ec0971b595. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:39.283518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Getting quotas for user aada82b4250745ab956466f29d1ddfb1 and project 8fd848b22f854563a0ab63ec0971b595. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:39.323672 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:23:39.326580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:23:39.453515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e8674f23-1630-409c-bf6d-3c6ac40afc8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: .version_select at 0x7ff522493430>, body: {"keypair": {"name": "tempest-keypair-1935280940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6hrT1hLEg/baZJPk0Oz2i/gBoQX9Bm9u70hUfl7Hrj3RcTH3Q7S5Rhf6ToOZWUp2DYEI6+rQOmGqEpeMEPSxxnqk4XOaVyfNG0eHKO82fzKyjug8PMmg9I0WDvq6FlnA=="}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:39.526856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-03bf2563-1b32-4d39-b9ef-91877483e9f6 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.828789 Sep 19 11:23:39.541328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 5/9] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:23:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:23:39.565452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4b810603-0ed7-429d-b5b2-6823da0ec8a5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:39.568171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4b810603-0ed7-429d-b5b2-6823da0ec8a5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:39.654408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-e8674f23-1630-409c-bf6d-3c6ac40afc8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:39.671624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-e8674f23-1630-409c-bf6d-3c6ac40afc8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for user 9a4a7aca62974db38138a38de399139f and project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:39.814459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e8674f23-1630-409c-bf6d-3c6ac40afc8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.714954 Sep 19 11:23:39.839415 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 5/10] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:23:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:23:40.078184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4b810603-0ed7-429d-b5b2-6823da0ec8a5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:40.131842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4b810603-0ed7-429d-b5b2-6823da0ec8a5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1214 microversion: 2.1 time: 0.579726 Sep 19 11:23:40.133643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 6/11] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:39 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1214 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:40.819803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-206098583", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:41.038971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] validate_networks() for [('8f760d48-3e02-4562-abc4-dc5b172f3b8a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:23:41.160724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d4eb9563-db37-404d-b221-2c43f22da88e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:41.162257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d4eb9563-db37-404d-b221-2c43f22da88e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:41.531678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d4eb9563-db37-404d-b221-2c43f22da88e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:41.544341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d4eb9563-db37-404d-b221-2c43f22da88e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1214 microversion: 2.1 time: 0.384804 Sep 19 11:23:41.546895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 7/12] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:41 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1214 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:23:42.576803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:42.578368 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:42.591831 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:42.595133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:42.598456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:42.599251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:42.599736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:42.601784 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:43.226027 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:43.249171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9f957a48-6dfd-485c-b6d6-b82ffe6be802 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1210 microversion: 2.1 time: 0.676686 Sep 19 11:23:43.265303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 8/13] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:42 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1210 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:43.330014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:23:43.330550 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:23:43.330907 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:23:43.331313 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:23:43.331943 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:23:43.355794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:43.359428 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:43.360929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:43.365503 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:43.370246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:43.370900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:43.436325 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:43.449065 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for user 9f160368e1984319ad4fa37c2794a956 and project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:43.483135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:23:43.486101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:23:43.711191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3885b434-d869-427d-84c9-9c88bde85df7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.868856 Sep 19 11:23:43.712690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 6/14] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:23:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:23:43.732343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d7e16a33-39df-44de-9073-3bab8bfcc689 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:43.732968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d7e16a33-39df-44de-9073-3bab8bfcc689 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:43.922824 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d7e16a33-39df-44de-9073-3bab8bfcc689 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:43.942643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d7e16a33-39df-44de-9073-3bab8bfcc689 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1221 microversion: 2.1 time: 0.215250 Sep 19 11:23:43.945693 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 9/15] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:43 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1221 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:44.176740 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-695517591", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:44.194953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6d446e45-eabe-4fdc-b115-94076339935f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'create', calling method: .version_select at 0x7ff52241db80>, body: {"keypair": {"name": "tempest-keypair-894629717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDBe9Rr7jRGW/W/uLb71lsHk26G7EjCakeccNSiaooDHcxsWtzBpOOLD+j6McdutoTV08YV1qzAWtT7EWmV/dqmrRHbVGw+gaMPOGmk6RnkfkUu8JTaOwjIcad/8LpwJg=="}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:44.274767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-6d446e45-eabe-4fdc-b115-94076339935f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for project 078bf59c33cc43579aeb270262079a37. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:44.291997 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-6d446e45-eabe-4fdc-b115-94076339935f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for user a3097d9c130746ca840bf85f33bc006b and project 078bf59c33cc43579aeb270262079a37. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:44.367681 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] validate_networks() for [('8f760d48-3e02-4562-abc4-dc5b172f3b8a', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:23:44.415481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6d446e45-eabe-4fdc-b115-94076339935f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.572592 Sep 19 11:23:44.434250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 7/16] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 11:23:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 594 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 11:23:44.453863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:44.454962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:44.476283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:44.478011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:44.480581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:44.482587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:44.483589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:44.484289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:45.327043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:45.420292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-aebb4b53-eec2-4f87-abb3-75a7e67ca8cc tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1272 microversion: 2.1 time: 0.981014 Sep 19 11:23:45.428880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 8/17] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:44 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1272 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:46.458536 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:46.459502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:46.480828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:46.485116 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:46.486260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:46.487178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:46.491680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:46.492171 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:46.992070 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:47.009477 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ce4c49ef-00e3-4740-a9f6-a94110965317 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1272 microversion: 2.1 time: 0.550639 Sep 19 11:23:47.011200 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 9/18] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:46 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1272 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:23:48.038336 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:48.038973 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:48.058114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:48.058714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:48.059170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:48.059951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:48.064295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:48.066291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:48.303581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:48.336086 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4f377e6f-0a6a-466e-ac1e-9a9a0eb5f7be tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1272 microversion: 2.1 time: 0.300069 Sep 19 11:23:48.341595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 10/19] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:48 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:48.898804 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1032567804", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79977212-9704-4425-8d7a-e6522d6f3c5b"}], "security_groups": [{"name": "tempest-securitygroup--869083257"}], "key_name": "tempest-keypair-1935280940", "user_data": "}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:49.235261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:49.891306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:23:49.892102 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:23:49.892814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:23:49.893345 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:23:49.893879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:23:49.932510 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:49.933786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:49.937910 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:49.941964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:49.948542 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:49.949712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:50.075499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:50.104590 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for user 9f160368e1984319ad4fa37c2794a956 and project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:50.163754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:23:50.177913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:23:50.370514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7c15e4e3-5c05-4a92-a20c-5fc0403f5f47 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.199044 Sep 19 11:23:50.383247 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 10/20] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:23:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 6207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:23:50.393378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] validate_networks() for [('79977212-9704-4425-8d7a-e6522d6f3c5b', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:23:50.394058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:50.394275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:50.424700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:50.425205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:50.425649 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:50.434761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:50.435358 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:50.435732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:52.673001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:52.698501 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4bb75972-7d2e-4cc0-b350-980566e9377e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 2.311350 Sep 19 11:23:52.703487 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 11/21] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:50 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:52.739059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:52.740366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:52.768236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:52.768781 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:52.770891 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:52.788114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:52.788705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:52.789165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:53.410800 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:53.995939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:54.026405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6a519b7d-9cb2-4a72-b109-0cce8eed0604 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1273 microversion: 2.1 time: 1.321082 Sep 19 11:23:54.032034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 12/22] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:52 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1273 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:54.054992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:54.055626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:54.075502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:54.084786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:54.088041 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:54.089567 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:54.094978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:54.095440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:54.338333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=14 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:55.777978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:55.787540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-03d3d165-454c-40c6-aa07-31e69d05c2c2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 1.751800 Sep 19 11:23:55.796440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 13/23] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:54 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:55.807020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:55.807020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:55.817691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:55.818601 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:55.819059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:55.835008 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:55.836904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:55.838161 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:56.210029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:56.226895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8cbfa4ea-1ad6-43c3-98c9-a729fda5860b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1279 microversion: 2.1 time: 0.429030 Sep 19 11:23:56.231843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 14/24] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:55 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1279 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:56.279246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-378865168", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3f42746-643a-44f8-bda0-c0503923c439"}], "security_groups": [{"name": "tempest-securitygroup--1483523224"}], "key_name": "tempest-keypair-894629717", "user_data": "}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:23:56.692613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] validate_networks() for [('f3f42746-643a-44f8-bda0-c0503923c439', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:23:56.770344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:23:56.771019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:23:56.771383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:23:56.771687 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:23:56.772904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:23:56.802769 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:56.802769 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:56.803133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:56.803835 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:56.804303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:56.806343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:56.861263 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:56.866126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for user 9a4a7aca62974db38138a38de399139f and project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:56.905607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:23:56.922047 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:23:57.049423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d07bd595-6703-44a7-8632-d8d04e28e31a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 8.161876 Sep 19 11:23:57.055111 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 11/25] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:23:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 8169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:23:57.069848 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:57.070472 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:57.091543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:57.092127 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:57.099574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:57.110081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:57.110763 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:57.111378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.169317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:59.197059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b5daaa2f-3978-4cd4-8328-9e10f60d84ae tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 2.140446 Sep 19 11:23:59.219329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 12/26] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:57 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:59.255880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:59.261856 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:59.299304 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:59.303085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:59.308295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.309998 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:59.313609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:59.314899 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.585284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:23:59.598688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-28ca6930-7474-4a40-b9f9-dab8802c374f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1290 microversion: 2.1 time: 0.377316 Sep 19 11:23:59.602140 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 13/27] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:59 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1290 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:23:59.618554 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:59.619300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:23:59.635082 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:59.638633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:59.639223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.641391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:59.644054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:59.644589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.882772 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:23:59.883914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:23:59.885088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:23:59.885664 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:23:59.886504 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:23:59.902353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:59.902892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:59.905482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.907616 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:59.908888 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:59.910863 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:59.940436 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for project 078bf59c33cc43579aeb270262079a37. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:23:59.945473 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for user a3097d9c130746ca840bf85f33bc006b and project 078bf59c33cc43579aeb270262079a37. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:23:59.967378 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:23:59.970390 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:24:00.084629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b74112eb-6cb6-4652-aec1-0ad697a21547 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.834399 Sep 19 11:24:00.086195 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 15/28] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 11:23:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3853 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 11:24:00.099478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-97f6fafd-e99b-41ef-90ba-c59512d93c31 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:00.100850 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-97f6fafd-e99b-41ef-90ba-c59512d93c31 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:00.444838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-97f6fafd-e99b-41ef-90ba-c59512d93c31 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:00.461911 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-97f6fafd-e99b-41ef-90ba-c59512d93c31 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:00.470543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-97f6fafd-e99b-41ef-90ba-c59512d93c31 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:00.474961 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-97f6fafd-e99b-41ef-90ba-c59512d93c31 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1280 microversion: 2.20 time: 0.381606 Sep 19 11:24:00.480723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 16/29] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:00 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:24:00.491453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:00.501082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:00.527847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:00.528361 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:00.528946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:00.542162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:00.542897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:00.543482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:00.570367 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:00.586754 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-140ea4e4-687f-4756-88ec-6c5e7c372c2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.980707 Sep 19 11:24:00.588847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 14/30] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:23:59 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:00.953665 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa6ead2-6eb3-4248-aa4f-76b526b373fc", "tag": "8b1399aa-63ac-460e-a185-4338a45c416c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:00.986028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:00.986302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:00.986847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:01.056243 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Creating event network-changed:8b1399aa-63ac-460e-a185-4338a45c416c for instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc on hv-cinder-82099 Sep 19 11:24:01.061260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120459) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 11:24:01.062284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-30a9fe94-90c1-4eca-941c-59064fb9cb13 req-ed105de9-e844-40b4-afec-ed8ad778214c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120459) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 11:24:01.084427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:01.085228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:01.085863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:01.091576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:01.094875 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:01.096469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:01.142230 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.compute.rpcapi [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 11:24:01.143465 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=120459) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 11:24:01.176107 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a9380773-37ad-49dc-a55d-610969c7e9e3 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556790 Sep 19 11:24:01.178623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:01.188005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:01.193693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:01.207460 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:01.208114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:01.208433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:01.213523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:01.217459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:01.219279 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:01.751227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:01.760974 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0726e3bc-29ad-40cc-a461-a9a8502da44e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1296 microversion: 2.1 time: 0.580946 Sep 19 11:24:01.763132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 16/32] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:01 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1296 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:01.852352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:01.861620 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9ec2af11-2fa9-4e66-bf00-bbb92df311df tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 1.379328 Sep 19 11:24:01.862080 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 17/33] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:00 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:01.875547 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:01.876195 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:01.891363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:01.891897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:01.892346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:01.893071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:01.893521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:01.893955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.005975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:02.015916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:02.017734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:02.019096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5608dd21-0640-4b13-8d5d-b549adb187d9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1332 microversion: 2.20 time: 0.156109 Sep 19 11:24:02.020312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 18/34] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:01 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:02.036253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:02.036944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:02.043023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.043591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.044236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.044998 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.045677 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.046191 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.096552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-6d9061f9-3148-4c5a-a087-809caf0ad619 req-b90e5fe7-a6ef-45e1-827c-2874a44fecaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1fde0ab-90d4-496f-8d81-15056c43a44e", "tag": "f759b9af-a4de-46a2-b77f-a99514276d61"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:02.106516 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6d9061f9-3148-4c5a-a087-809caf0ad619 req-b90e5fe7-a6ef-45e1-827c-2874a44fecaa service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.107007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6d9061f9-3148-4c5a-a087-809caf0ad619 req-b90e5fe7-a6ef-45e1-827c-2874a44fecaa service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.107451 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6d9061f9-3148-4c5a-a087-809caf0ad619 req-b90e5fe7-a6ef-45e1-827c-2874a44fecaa service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.119490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-6d9061f9-3148-4c5a-a087-809caf0ad619 req-b90e5fe7-a6ef-45e1-827c-2874a44fecaa service nova] Creating event network-changed:f759b9af-a4de-46a2-b77f-a99514276d61 for instance c1fde0ab-90d4-496f-8d81-15056c43a44e on hv-cinder-82099 Sep 19 11:24:02.125296 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-6d9061f9-3148-4c5a-a087-809caf0ad619 req-b90e5fe7-a6ef-45e1-827c-2874a44fecaa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359978 Sep 19 11:24:02.126063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:02.291955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:02.300305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-0987b2eb-ff2b-4b7a-9ce6-1f27a5052d1f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.278630 Sep 19 11:24:02.304828 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 19/36] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:02 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:02.792808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:02.794630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:02.807342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.809148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.810398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.811163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.811643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.812114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.889703 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:02.890328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:02.904671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.910881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.912955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:02.913904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:02.916327 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:02.917279 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.179534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:03.189228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-edf1ca4d-73cb-4a54-b1d7-436c4aaf5758 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.402513 Sep 19 11:24:03.190801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 18/37] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:02 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:03.196773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:03.197753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:03.204749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.206066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.206853 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.208452 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.209533 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.210174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.263311 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:03.271572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1e62f709-a507-475f-a867-93d04f699d08 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.385751 Sep 19 11:24:03.288228 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 20/38] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:02 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:03.295636 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781f01d3-aa65-40ad-9c85-0e93e6f05745", "tag": "d8d9d58e-5f33-4c6e-bba4-32413e04606d"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:03.306388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:03.317645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:03.317835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.318539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.319050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.320477 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:03.323327 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d3078ed7-0251-4a19-bdba-113222983b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1332 microversion: 2.20 time: 0.131289 Sep 19 11:24:03.325112 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:03 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1332 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:03.332062 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:03.332760 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:03.339032 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.339804 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.340288 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.341786 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.342411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.346392 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Creating event network-changed:d8d9d58e-5f33-4c6e-bba4-32413e04606d for instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 on hv-cinder-82099 Sep 19 11:24:03.347297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120458) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 11:24:03.347743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-90435430-1a29-48e0-acdb-9503fdda37f3 req-5079d2d6-6bc4-42d5-a335-3ddffd98d5b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120458) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 11:24:03.349330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.349986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.350655 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.351945 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:03.352435 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:03.353377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:03.364891 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.compute.rpcapi [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 11:24:03.365976 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] Releasing lock "compute-rpcapi-router" {{(pid=120458) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 11:24:03.388638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7948aec4-faec-419b-ac58-586d320a6a48 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098428 Sep 19 11:24:03.389563 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 21/40] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:03.532079 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:03.540939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0d842b0c-205d-414d-b7bb-5fe46779cf6a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.213791 Sep 19 11:24:03.541837 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 20/41] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:03 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:04.216870 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:04.217572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:04.223913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.224458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.224829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.225594 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.225948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.226366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.297501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:04.299600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:04.309288 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.309778 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.310408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.311670 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.312314 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.313034 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.406052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:04.421848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4feb99cc-6f26-42b5-ada0-7b7e6abd77c1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.208857 Sep 19 11:24:04.432962 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 22/42] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:04 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:04.441235 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:04.441962 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:04.453149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.453645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.454088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.456991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.457501 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.458383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.707042 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:04.709923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=75 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:04.731622 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:04.733052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:04.734174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-eb1c8507-31bc-4a4a-bc05-447ee699032c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1332 microversion: 2.20 time: 0.298371 Sep 19 11:24:04.734739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 23/43] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:04 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1332 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:04.762485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:04.763653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:04.770907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:04.773452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.773607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:04.774322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.775006 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.776461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:04.777140 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:04.777772 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:04.785587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e6326de6-6c43-4317-9623-516596129aa1 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.491357 Sep 19 11:24:04.805297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 21/44] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:04 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:05.069417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:05.084835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b6eec602-2a27-4052-a3c3-4cf18adcad94 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.327873 Sep 19 11:24:05.085486 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 24/45] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:04 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:05.448583 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:05.449959 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:05.458464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.459327 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.459956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.460856 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.461593 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.462792 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.633212 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:05.644799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f8c244e4-5d1b-4b48-bb57-974624a0994b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.203123 Sep 19 11:24:05.648157 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 22/46] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:05 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:05.761976 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:05.762647 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:05.772224 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.773082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.774379 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.776221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.776981 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.777557 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.803241 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-84d36394-d826-4361-a50b-09dce08dfd87 req-d61e114e-3775-4229-8cce-e14074fe855d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1", "tag": "be6dcfdf-14a9-42c6-8271-941d034d3349"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:05.822090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-84d36394-d826-4361-a50b-09dce08dfd87 req-d61e114e-3775-4229-8cce-e14074fe855d service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.824347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-84d36394-d826-4361-a50b-09dce08dfd87 req-d61e114e-3775-4229-8cce-e14074fe855d service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.825634 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-84d36394-d826-4361-a50b-09dce08dfd87 req-d61e114e-3775-4229-8cce-e14074fe855d service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.857404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-84d36394-d826-4361-a50b-09dce08dfd87 req-d61e114e-3775-4229-8cce-e14074fe855d service nova] Creating event network-changed:be6dcfdf-14a9-42c6-8271-941d034d3349 for instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 on hv-cinder-82099 Sep 19 11:24:05.871031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-84d36394-d826-4361-a50b-09dce08dfd87 req-d61e114e-3775-4229-8cce-e14074fe855d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071500 Sep 19 11:24:05.874335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 23/47] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:05.878717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:05.886796 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:05.887512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:05.896696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:05.898397 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.898932 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.899372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.900880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:05.901488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:05.901947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:05.902054 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a11af364-87f0-4039-9065-3bba0cbb8f2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1350 microversion: 2.20 time: 0.144415 Sep 19 11:24:05.902431 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:05.902558 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 25/48] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:05 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:06.081491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:06.091815 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a25e5585-91dd-480c-9ac4-1b93ce4836c0 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.212336 Sep 19 11:24:06.092840 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 24/49] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:05 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:06.115050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:06.115885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:06.126616 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:06.127426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:06.128091 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:06.131528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:06.132225 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:06.132941 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:06.639373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:06.653368 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-aa11adf5-4b39-4a39-bb63-d536d18b5111 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.543827 Sep 19 11:24:06.653971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 26/50] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:06 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:06.670482 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:06.671106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:06.684136 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:06.685302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:06.685930 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:06.686860 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:06.687474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:06.688213 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:06.884809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:06.929773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:06.932847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:06.947749 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:06.949533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:06.953070 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:06.956253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:06.957278 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:06.959613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:07.341492 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:07.354980 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:07.356808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:07.358422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-dda7baee-18d3-4377-9063-a16c9f882407 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1338 microversion: 2.20 time: 0.434334 Sep 19 11:24:07.378460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 27/51] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:06 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1338 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:07.384169 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:07.385105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:07.399183 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:07.400119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:07.400779 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:07.401842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:07.402513 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:07.403145 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:07.572274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:07.583051 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-003cdca8-8123-4035-983f-893a04bd506a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.918568 Sep 19 11:24:07.583473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 25/52] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:06 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:07.677567 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:07.678845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:07.679480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:07.687398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:07.687720 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a82df3ac-75e7-473e-8008-dba72bc11e60 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.307448 Sep 19 11:24:07.692804 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 28/53] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:07 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:07.693221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:07.693692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:07.694434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:07.694909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:07.695347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:07.741149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:08.387842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:08.390332 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:08.400739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:08.401614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:08.402637 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:08.412531 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:08.413087 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:08.413529 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:08.595941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:08.613231 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f5f28faa-5d31-4593-b406-a76b174a9c0a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.938504 Sep 19 11:24:08.614387 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 26/54] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:07 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:08.622650 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:08.625268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:08.642604 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:08.643249 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:08.644340 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:08.645434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:08.647945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:08.648933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:09.041989 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:09.054853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:09.062157 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:09.063476 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-47026b50-b003-431b-b113-948a7487a786 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.682208 Sep 19 11:24:09.066543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 29/55] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:08 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:09.075840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:09.076715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:09.093184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:09.094001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:09.095917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:09.096958 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:09.097640 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:09.098540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:09.271532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:09.281059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7f60532b-87b4-4bbc-afcf-8e83c5b81851 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.665441 Sep 19 11:24:09.281938 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 27/56] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:08 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:09.644702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:09.647101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:09.662402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:09.667476 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:09.670035 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:09.672601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:09.673824 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:09.676115 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:09.677210 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:09.978377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:09.992110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-84aaccb6-fa2a-41df-9d61-c7d8659b14f2 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.921763 Sep 19 11:24:09.995915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 30/57] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:09 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:10.094717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:10.096199 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:10.104434 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:10.105242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:10.105919 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:10.106825 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:10.107502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:10.108277 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:10.452289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=26 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:10.495359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:10.512835 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-cee216d7-9d44-4cfa-ada9-452d34252cda tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.878850 Sep 19 11:24:10.515341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 28/58] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:09 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:10.528273 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:10.529789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:10.546556 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:10.548690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:10.550966 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:10.552933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:10.553709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:10.555005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.015504 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:11.026279 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:11.028080 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:11.029460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ae947da8-a11c-4605-9f31-2d029d441023 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.940168 Sep 19 11:24:11.045148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 31/59] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:10 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:11.080541 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:11.093504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-253bd815-12ea-4f92-8650-4ccb7a2221f8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.572479 Sep 19 11:24:11.095443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 29/60] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:10 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:11.121693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:11.122320 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:11.136521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=4 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:11.144534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:11.145038 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:11.145479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.146191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:11.146649 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:11.147076 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.374170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:11.402795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-472faf59-1c49-46c0-a353-46e0372261fd req-2efe98dd-3a9f-40c3-9092-144778d66b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa6ead2-6eb3-4248-aa4f-76b526b373fc", "name": "network-vif-plugged", "status": "completed", "tag": "8b1399aa-63ac-460e-a185-4338a45c416c"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:11.403309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f8a10bd4-51ff-4444-b2f8-0bb39b704298 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.290267 Sep 19 11:24:11.423630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-472faf59-1c49-46c0-a353-46e0372261fd req-2efe98dd-3a9f-40c3-9092-144778d66b66 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:11.423881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 30/61] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:11 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:11.425067 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-472faf59-1c49-46c0-a353-46e0372261fd req-2efe98dd-3a9f-40c3-9092-144778d66b66 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:11.426051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-472faf59-1c49-46c0-a353-46e0372261fd req-2efe98dd-3a9f-40c3-9092-144778d66b66 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.434888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-d2969cd4-bbac-4831-8f5b-7d56d5541828 req-832f0b8d-a051-493d-bb18-968c7697e19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:11.448152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-472faf59-1c49-46c0-a353-46e0372261fd req-2efe98dd-3a9f-40c3-9092-144778d66b66 service nova] Creating event network-vif-plugged:8b1399aa-63ac-460e-a185-4338a45c416c for instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc on hv-cinder-82099 Sep 19 11:24:11.456353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d2969cd4-bbac-4831-8f5b-7d56d5541828 req-832f0b8d-a051-493d-bb18-968c7697e19a service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:11.457906 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-472faf59-1c49-46c0-a353-46e0372261fd req-2efe98dd-3a9f-40c3-9092-144778d66b66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.410887 Sep 19 11:24:11.468733 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 32/62] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:11.469617 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d2969cd4-bbac-4831-8f5b-7d56d5541828 req-832f0b8d-a051-493d-bb18-968c7697e19a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:11.469920 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d2969cd4-bbac-4831-8f5b-7d56d5541828 req-832f0b8d-a051-493d-bb18-968c7697e19a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.493057 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-d2969cd4-bbac-4831-8f5b-7d56d5541828 req-832f0b8d-a051-493d-bb18-968c7697e19a service nova] Creating event network-changed:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:24:11.497412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-d2969cd4-bbac-4831-8f5b-7d56d5541828 req-832f0b8d-a051-493d-bb18-968c7697e19a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072382 Sep 19 11:24:11.498565 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 31/63] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:11.540976 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:11.541674 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:11.547978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:11.548468 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:11.548905 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.549658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:11.550047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:11.550475 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:11.717440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:11.739201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9406680a-02cb-44ea-ac48-e4cd233137e2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.202815 Sep 19 11:24:11.740907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 33/64] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:11 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:12.070989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:12.072313 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:12.079442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.080127 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.080750 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.081629 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.082206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.082531 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.119644 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:12.120837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:12.129917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.130699 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.131802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.132807 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.133456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.134668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.326272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:12.337588 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:12.339466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:12.340863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-571f4835-2ac6-4bde-84e1-434bb9bc5edc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.274084 Sep 19 11:24:12.341854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:12 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:12.373959 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:12.390403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6e2e4f21-b09e-4a30-9e5b-be4ea95eec16 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.277218 Sep 19 11:24:12.390996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 34/66] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:12 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:12.431025 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:12.431778 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:12.438074 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.440211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.440746 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.441500 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.441961 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.442399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.647347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:12.662919 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ced503d1-a43a-49f9-b8a9-a42d69d7c2c7 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.236776 Sep 19 11:24:12.663672 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 33/67] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:12 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:12.764624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:12.765574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:12.772918 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.773741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.774341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.775312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:12.775947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:12.776370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:12.949794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:12.960896 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-23e9e3d4-fb05-406d-88f5-0e6398aa482a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.199056 Sep 19 11:24:12.962457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 35/68] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:12 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:13.374123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:13.375116 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:13.383103 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.384480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.385033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.385743 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.386197 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.386619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.417307 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:13.419903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:13.430028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:13.434015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.434739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.435194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.436246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.436775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.437813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.604400 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:13.626219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:13.628200 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:13.630189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a7578852-b77c-4173-9be0-1d9e4b75e158 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.261208 Sep 19 11:24:13.631214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 34/69] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:13 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:13.680875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:13.687744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:13.688534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:13.697837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-419c01e8-a31a-4978-9b6a-2d585c5ffda1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.287673 Sep 19 11:24:13.698843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 36/70] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:13 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:13.713736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.714243 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.714689 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.715400 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.717893 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.718364 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.879127 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:13.889220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b29b42c6-ec9d-4e47-a5ee-0a050df4daaa tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.205010 Sep 19 11:24:13.899546 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 35/71] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:13 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:13.988864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:13.991745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:14.002753 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:14.011864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:14.015568 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:14.018377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:14.018996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:14.022457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:14.597005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:14.616068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-36c27c43-3164-4397-bfa7-25dff44292f9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.635493 Sep 19 11:24:14.616849 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 37/72] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:13 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:14.656503 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:14.657379 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:14.671173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:14.672989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:14.673436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:14.674152 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:14.681176 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:14.681666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:14.725442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:14.726301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:14.733657 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:14.734142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:14.734574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:14.735267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:14.748811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:14.749917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:15.282277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:15.291954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:15.293613 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:15.295096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-389d31fd-ce86-4c09-80a2-fe14014d1839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.643344 Sep 19 11:24:15.295876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 36/73] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:14 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:15.305017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:15.306380 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:15.314268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:15.314770 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:15.315217 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:15.316335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:15.316939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:15.317474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:15.334636 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:15.345007 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-841017fd-fd7a-45b6-8139-96a08167c8fd tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.623404 Sep 19 11:24:15.347359 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 38/74] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:14 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:15.554825 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:15.567794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-67f4c490-427e-4245-b2b8-a902df6f0c8d tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.270594 Sep 19 11:24:15.568408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 37/75] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:15 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:15.633309 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-67ddda17-1b29-403d-94ca-ae3e9ed81a73 req-758186c7-a895-4830-a8fd-b6fa0919a78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f01d3-aa65-40ad-9c85-0e93e6f05745", "name": "network-vif-plugged", "status": "completed", "tag": "d8d9d58e-5f33-4c6e-bba4-32413e04606d"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:15.640602 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:15.641291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:15.645045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-67ddda17-1b29-403d-94ca-ae3e9ed81a73 req-758186c7-a895-4830-a8fd-b6fa0919a78c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:15.645662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-67ddda17-1b29-403d-94ca-ae3e9ed81a73 req-758186c7-a895-4830-a8fd-b6fa0919a78c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:15.646124 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-67ddda17-1b29-403d-94ca-ae3e9ed81a73 req-758186c7-a895-4830-a8fd-b6fa0919a78c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:15.648869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:15.650209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:15.651103 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:15.652446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:15.653169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:15.653853 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:15.691229 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-67ddda17-1b29-403d-94ca-ae3e9ed81a73 req-758186c7-a895-4830-a8fd-b6fa0919a78c service nova] Creating event network-vif-plugged:d8d9d58e-5f33-4c6e-bba4-32413e04606d for instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 on hv-cinder-82099 Sep 19 11:24:15.701754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-67ddda17-1b29-403d-94ca-ae3e9ed81a73 req-758186c7-a895-4830-a8fd-b6fa0919a78c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072703 Sep 19 11:24:15.703615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 39/76] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:15.870895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:15.879903 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-36fa828c-ecf7-4a7d-8c05-099df566f546 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.244092 Sep 19 11:24:15.882774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 38/77] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:15 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:16.324754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:16.325894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:16.341783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.344835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.345500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.349029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.349525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.349971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.374226 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:16.374995 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:16.385934 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.388599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.389059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.389777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.391272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.394677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.645916 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:16.657677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9fb64d5f-1650-4102-8397-5d977f0ee80a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.292183 Sep 19 11:24:16.672032 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:16.673332 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 39/78] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:16 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:16.682215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:16.682669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:16.683178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:16.684420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:16.685631 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-55be765f-ae51-4ec1-a8f8-69e7ccd99375 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.367337 Sep 19 11:24:16.686361 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 40/79] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:16 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:16.690594 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.691369 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.691854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.692733 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.693380 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.693965 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.854135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:16.863405 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2e5f97c4-9a54-41c8-8bd1-5c17422f3102 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1314 microversion: 2.1 time: 0.187705 Sep 19 11:24:16.864090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 40/80] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:16 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:16.907716 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:16.908467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:16.914561 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.915215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.915838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:16.916546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:16.917071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:16.917583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:17.051897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:17.054171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=100 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:17.061766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-369e7b77-dcfb-4285-80c9-8f008a36f167 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.158104 Sep 19 11:24:17.062483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 41/81] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:16 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:17.687492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:17.688667 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:17.708175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:17.708175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:17.708175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:17.708175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:17.708504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:17.708504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:17.711182 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:17.712996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:17.727973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:17.728861 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:17.730142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:17.732637 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:17.733903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:17.736250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:17.995729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:17.996403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:18.007122 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c0b750a6-edf2-4713-8b18-75f175534f04 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.323563 Sep 19 11:24:18.007945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 41/82] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:17 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:18.010003 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:18.011447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:18.012572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d839eefc-f799-40cb-9361-ed2dc0ce7d67 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.306625 Sep 19 11:24:18.013113 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-90514bdb-37cf-4fa5-88e8-894befa0e6fd req-bdce3235-e057-4ed0-9da9-714843424d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fde0ab-90d4-496f-8d81-15056c43a44e", "name": "network-vif-plugged", "status": "completed", "tag": "f759b9af-a4de-46a2-b77f-a99514276d61"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:18.013245 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 42/83] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:17 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:24:18.024797 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-90514bdb-37cf-4fa5-88e8-894befa0e6fd req-bdce3235-e057-4ed0-9da9-714843424d9c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:18.025573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-90514bdb-37cf-4fa5-88e8-894befa0e6fd req-bdce3235-e057-4ed0-9da9-714843424d9c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:18.026166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-90514bdb-37cf-4fa5-88e8-894befa0e6fd req-bdce3235-e057-4ed0-9da9-714843424d9c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:18.040384 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-90514bdb-37cf-4fa5-88e8-894befa0e6fd req-bdce3235-e057-4ed0-9da9-714843424d9c service nova] Creating event network-vif-plugged:f759b9af-a4de-46a2-b77f-a99514276d61 for instance c1fde0ab-90d4-496f-8d81-15056c43a44e on hv-cinder-82099 Sep 19 11:24:18.045639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:18.046221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:18.047504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-90514bdb-37cf-4fa5-88e8-894befa0e6fd req-bdce3235-e057-4ed0-9da9-714843424d9c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037829 Sep 19 11:24:18.048874 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 42/84] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:18.056798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:18.057467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:18.058469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:18.059325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:18.060266 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:18.060829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:18.089426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:18.091071 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:18.100166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:18.101183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:18.101896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:18.103572 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:18.115315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:18.118507 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:18.248522 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:18.256523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-14d6026c-d353-4c83-8b4b-a6a562f15a4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1502 microversion: 2.1 time: 0.242430 Sep 19 11:24:18.257100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 43/85] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:18 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:18.382169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:18.394270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f157ceff-9174-4a7b-8ab6-bb0c94296475 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.312678 Sep 19 11:24:18.397479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 43/86] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:18 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:19.031604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:19.033001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:19.039537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.040318 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:19.040886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:19.042483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.043258 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.044221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.044891 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.045507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.054648 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.055066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.064306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.066740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.067639 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.068124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.108854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:19.439081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:19.450114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:19.452977 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:19.456091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:19.459178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-df5ed3f0-0677-4995-8d89-011345cb7daa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.432294 Sep 19 11:24:19.459686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-23cf5bc7-2d07-4c22-8c62-b4d0cd1f97ee tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.425040 Sep 19 11:24:19.461897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 44/87] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:19 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:19.467095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:19.468056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:19.473302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 44/88] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:19 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:19.477701 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.478942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.479609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.480925 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.481579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.482416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.715568 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:19.732775 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-dc534bf8-3d9a-4f34-983e-fe4bbf67e452 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1321 microversion: 2.1 time: 0.269491 Sep 19 11:24:19.733783 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 45/89] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:19 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:19.817770 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8abe1f-cdf0-442c-b1ed-6f2442e69f21"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:19.820821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:19.829580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.830528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.831234 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:19.832332 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:19.833037 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:19.833657 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.081488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-b82f8237-efec-40ff-8e2b-e317f1af4b50 req-960c279d-38be-477b-8012-ba7dee158e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1", "name": "network-vif-plugged", "status": "completed", "tag": "be6dcfdf-14a9-42c6-8271-941d034d3349"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:20.094686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-b82f8237-efec-40ff-8e2b-e317f1af4b50 req-960c279d-38be-477b-8012-ba7dee158e6e service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.095991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-b82f8237-efec-40ff-8e2b-e317f1af4b50 req-960c279d-38be-477b-8012-ba7dee158e6e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.100930 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-b82f8237-efec-40ff-8e2b-e317f1af4b50 req-960c279d-38be-477b-8012-ba7dee158e6e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.169086 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-b82f8237-efec-40ff-8e2b-e317f1af4b50 req-960c279d-38be-477b-8012-ba7dee158e6e service nova] Creating event network-vif-plugged:be6dcfdf-14a9-42c6-8271-941d034d3349 for instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 on hv-cinder-82099 Sep 19 11:24:20.182075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-b82f8237-efec-40ff-8e2b-e317f1af4b50 req-960c279d-38be-477b-8012-ba7dee158e6e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107248 Sep 19 11:24:20.186011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 46/90] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:20.484874 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:20.485827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:20.514244 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.515086 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.521530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.524678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.526404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.533123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.863175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e492c8f1-af53-4858-8cc4-a205e11abd1b tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "POST /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.054179 Sep 19 11:24:20.869343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 45/91] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:24:19 2022] POST /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc/os-volume_attachments => generated 194 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:20.881918 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:20.882928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:20.893947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:20.897365 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.901659 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.902381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.903118 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.903287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5527317a-33e7-45b2-bee2-c778be5d4a14 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.422932 Sep 19 11:24:20.903586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.904045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.935416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 47/92] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:20 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:20.940618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:20.941764 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:20.960359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.963639 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.964363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:20.966594 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:20.967289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:20.967987 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:21.247420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:21.256275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:21.257736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:21.259394 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5e57bdc2-6e4e-43ea-9bee-b4507efe9e11 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.388543 Sep 19 11:24:21.259987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 46/93] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:20 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:21.340735 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:21.353469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7e8468b2-7c84-4eb0-92ec-aef89326baae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1515 microversion: 2.1 time: 0.415384 Sep 19 11:24:21.354534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 48/94] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:20 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:21.377386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:21.380089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:21.387091 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:21.387629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:21.388241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:21.389004 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:21.389627 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:21.390168 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:21.416920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lazy-loading 'flavor' on Instance uuid c1fde0ab-90d4-496f-8d81-15056c43a44e {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:24:21.560227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-97ef4dd1-326c-43ca-80b3-66db18b0176b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e/action" status: 200 len: 32 microversion: 2.1 time: 0.186708 Sep 19 11:24:21.560827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 47/95] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:24:21 2022] POST /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:24:21.570428 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:21.571115 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:21.578799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:21.579513 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:21.580161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:21.581075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:21.581843 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:21.582443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:21.785306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:21.796144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5f0425a1-7c1b-404d-94b0-42d5a0e8a579 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.227731 Sep 19 11:24:21.797382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 49/96] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:21 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:21.943723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:21.944564 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:21.954274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:21.954998 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:21.955450 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:21.956194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:21.956858 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:21.957383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:22.177807 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:22.186251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-facbb34d-4784-4cd0-9e37-fdce09a10f58 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1363 microversion: 2.1 time: 0.247175 Sep 19 11:24:22.186901 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 48/97] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:21 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:22.219990 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-79dcc7fa-9b3f-43c4-847f-cee879bd26f9 req-8ce2ba97-170b-48cc-a51a-13356e22df0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "name": "network-vif-plugged", "status": "completed", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:22.232651 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-79dcc7fa-9b3f-43c4-847f-cee879bd26f9 req-8ce2ba97-170b-48cc-a51a-13356e22df0a service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:22.233442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-79dcc7fa-9b3f-43c4-847f-cee879bd26f9 req-8ce2ba97-170b-48cc-a51a-13356e22df0a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:22.234094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-79dcc7fa-9b3f-43c4-847f-cee879bd26f9 req-8ce2ba97-170b-48cc-a51a-13356e22df0a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:22.252014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-79dcc7fa-9b3f-43c4-847f-cee879bd26f9 req-8ce2ba97-170b-48cc-a51a-13356e22df0a service nova] Creating event network-vif-plugged:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:24:22.257193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-79dcc7fa-9b3f-43c4-847f-cee879bd26f9 req-8ce2ba97-170b-48cc-a51a-13356e22df0a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041813 Sep 19 11:24:22.257193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 50/98] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:22.284492 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:22.285257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:22.291616 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:22.292391 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:22.292815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:22.294115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:22.294854 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:22.295432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:22.507364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:22.516942 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:22.518402 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:22.519753 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7232550b-9a6e-45ef-9b9c-20c2eaf2a8f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.239343 Sep 19 11:24:22.520390 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 49/99] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:22 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:22.821536 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:22.822359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:22.830421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:22.831339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:22.832013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:22.832918 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:22.834342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:22.835145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.220145 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:23.220767 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:23.227715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:23.232832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:23.233441 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.234546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:23.239337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:23.240045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.281960 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:23.294391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f77a2668-4585-4cf3-99d6-17be308b11b5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.477444 Sep 19 11:24:23.295882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 51/100] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:22 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:23.548926 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:23.551795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:23.561052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:23.562108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:23.563297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.565339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:23.566407 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:23.567306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.596762 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:23.606739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-40b8c19f-c530-4646-82ac-5b4b17180d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1549 microversion: 2.1 time: 0.400153 Sep 19 11:24:23.607875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 50/101] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:23 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1549 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:23.633017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:23.633861 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:23.640639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:23.641474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:23.642082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.643249 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:23.644055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:23.645481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:23.769497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-351aa6e5-ad43-4624-93ad-2478765733ca tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139973 Sep 19 11:24:23.771253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 51/102] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:24:23 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:24.002052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:24.024098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:24.026897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:24.029897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-85140b71-7e64-420c-a500-f4111fd2aa8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1406 microversion: 2.20 time: 0.486439 Sep 19 11:24:24.030858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 52/103] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:23 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:24:24.324190 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:24.324811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:24.335971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:24.337962 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:24.340116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:24.342021 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:24.343410 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:24.345328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:24.551555 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:24.561541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5940f023-f110-46a4-9446-5b441f2c1ea5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.247127 Sep 19 11:24:24.568718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 52/104] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:24 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:25.059071 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:25.059702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:25.069595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.071492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.071971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.073178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.074167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.074833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.312721 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:25.323096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:25.324623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:25.339556 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-df162f7d-e385-4970-accc-78d47b1a9310 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1597 microversion: 2.20 time: 0.272172 Sep 19 11:24:25.339556 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 53/105] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:24:25 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1597 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:25.354306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:25.354897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:25.362538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.363183 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.363880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.364679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.365234 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.365777 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.512793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f12177dd-1529-4135-be1c-8e33e08a3f68 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.147925 Sep 19 11:24:25.514022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 53/106] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 11:24:25 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:24:25.589836 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:25.592075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:25.601457 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.604158 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.604790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.606446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.608880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.609489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.765841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-ca3b56c2-01e3-429d-bef7-bde3dc0ed950 req-15b0722c-b055-42d9-9553-bcea90b8db16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1", "tag": "be6dcfdf-14a9-42c6-8271-941d034d3349"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:25.783343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-ca3b56c2-01e3-429d-bef7-bde3dc0ed950 req-15b0722c-b055-42d9-9553-bcea90b8db16 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:25.783835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-ca3b56c2-01e3-429d-bef7-bde3dc0ed950 req-15b0722c-b055-42d9-9553-bcea90b8db16 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:25.784264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-ca3b56c2-01e3-429d-bef7-bde3dc0ed950 req-15b0722c-b055-42d9-9553-bcea90b8db16 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:25.800346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-ca3b56c2-01e3-429d-bef7-bde3dc0ed950 req-15b0722c-b055-42d9-9553-bcea90b8db16 service nova] Creating event network-changed:be6dcfdf-14a9-42c6-8271-941d034d3349 for instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 on hv-cinder-82099 Sep 19 11:24:25.807138 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-ca3b56c2-01e3-429d-bef7-bde3dc0ed950 req-15b0722c-b055-42d9-9553-bcea90b8db16 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045529 Sep 19 11:24:25.807724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 54/107] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:25.994761 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:26.003436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b00e5ea5-492c-4411-95e1-40593c72423d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.417376 Sep 19 11:24:26.012339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 54/108] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:25 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:27.034056 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:27.034771 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:27.045711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:27.046340 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:27.046935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:27.048695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:27.049360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:27.050503 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:27.420638 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-4d29be52-75b3-4f4d-b622-af11596e8404 req-6a84a87d-c9ce-44f8-aef0-5a00dd39b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:27.426528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:27.431256 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-4d29be52-75b3-4f4d-b622-af11596e8404 req-6a84a87d-c9ce-44f8-aef0-5a00dd39b3b1 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:27.432005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-4d29be52-75b3-4f4d-b622-af11596e8404 req-6a84a87d-c9ce-44f8-aef0-5a00dd39b3b1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:27.432879 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-4d29be52-75b3-4f4d-b622-af11596e8404 req-6a84a87d-c9ce-44f8-aef0-5a00dd39b3b1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:27.435079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f5a7fc48-fc99-44f7-8efe-59e73e185217 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.407699 Sep 19 11:24:27.436086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 55/109] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:27 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:27.461094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-4d29be52-75b3-4f4d-b622-af11596e8404 req-6a84a87d-c9ce-44f8-aef0-5a00dd39b3b1 service nova] Creating event network-changed:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:24:27.467989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-4d29be52-75b3-4f4d-b622-af11596e8404 req-6a84a87d-c9ce-44f8-aef0-5a00dd39b3b1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050279 Sep 19 11:24:27.468794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 55/110] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:28.460393 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:28.461677 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:28.468906 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:28.469611 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:28.470113 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:28.470886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:28.471414 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:28.471935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:28.487221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:28.627257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:28.636453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4e5dd9bd-e9a4-45f3-bab3-659d2234401c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.182089 Sep 19 11:24:28.637019 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 56/111] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:28 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:29.662495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:29.665036 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:29.671584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:29.672374 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:29.673074 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:29.675036 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:29.675517 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:29.676008 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:29.811883 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:29.820436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-126f65e1-f5e3-4f75-8fb9-9c10ef3039cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.163647 Sep 19 11:24:29.821812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 56/112] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:29 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:30.844294 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:30.844989 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:30.851681 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:30.852212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:30.852649 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:30.853336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:30.853789 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:30.854213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:30.984751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:30.992866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-19d49451-4d93-4aed-b538-41e1ca7a636e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.152480 Sep 19 11:24:30.993443 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 57/113] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:30 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:32.018627 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:32.019275 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:32.026314 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:32.026806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:32.027244 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:32.027984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:32.028442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:32.028869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:32.167859 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:32.176790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5d31b3c0-514c-4b7f-91ef-bb4622536262 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.162015 Sep 19 11:24:32.177374 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 57/114] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:32 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:33.202107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:33.204207 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:33.211448 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:33.212951 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:33.213400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:33.214083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:33.214572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:33.214995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:33.351418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:33.358978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-abc26804-52ee-4e49-9095-374505321959 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.160938 Sep 19 11:24:33.359554 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 58/115] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:33 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:34.357024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:34.357514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:34.366454 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:34.366933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:34.367914 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:34.368708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:34.369162 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:34.369590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:34.381435 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:34.384371 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:34.390849 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:34.391334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:34.391780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:34.392488 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:34.392929 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:34.393346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:34.400756 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:24:34.549310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-31fb26de-69a0-49d7-a9ca-930a769b8827 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 204 len: 0 microversion: 2.1 time: 0.195043 Sep 19 11:24:34.550205 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 58/116] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:24:34 2022] DELETE /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:24:34.556170 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:34.559978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:34.560885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:34.564205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7ae662f5-6f5e-4136-86fe-964448a021de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.186707 Sep 19 11:24:34.564774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 59/117] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:34 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:34.568350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:34.568350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:34.568682 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:34.569531 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:34.570003 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:34.570411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:34.708816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:34.717652 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-703ed880-9f1b-4bb0-9362-875a2fca6547 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1554 microversion: 2.1 time: 0.162637 Sep 19 11:24:34.718229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 59/118] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:34 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:35.589280 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:35.589893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:35.592260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=72 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:35.602289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:35.602775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:35.603210 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:35.608127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:35.608645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:35.609085 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:35.741716 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:35.742726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:35.749354 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:35.750203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:35.750647 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:35.751355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:35.751845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:35.751946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:35.752589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:35.761058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-87a542c8-ddcb-4ff4-935c-5db0eadc4f90 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.176280 Sep 19 11:24:35.761630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 60/119] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:35 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:35.901480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:35.910044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-83746651-c1e7-4404-b293-b678254ffc01 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1554 microversion: 2.1 time: 0.172117 Sep 19 11:24:35.910626 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 60/120] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:35 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:36.785965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:36.786680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:36.794269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:36.794820 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:36.795378 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:36.796102 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:36.796686 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:36.797000 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:36.936811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:36.937156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:36.954983 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c942f651-f5b1-4c00-93aa-4b320d1556d3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.164024 Sep 19 11:24:36.954983 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 61/121] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:36 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:36.955879 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:36.962838 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:36.963326 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:36.963940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:36.964659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:36.965110 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:36.965638 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:36.985334 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:37.100398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:37.109082 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-00dc5077-9928-47a6-891a-a733092ed604 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1554 microversion: 2.1 time: 0.179384 Sep 19 11:24:37.109584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 61/122] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:36 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:37.969196 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:37.969807 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:37.975733 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:37.976268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:37.976687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:37.978012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:37.978470 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:37.978893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:38.129312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:38.133897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:38.134729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:38.138075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9ac45dee-f0b6-481f-a7c7-b512b79393c4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.173518 Sep 19 11:24:38.139748 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 62/123] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:37 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:38.145793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:38.147207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:38.152281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:38.152790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:38.153251 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:38.153684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:38.309222 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:38.317848 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-513aeb76-2741-497c-9bda-cfb4ac5c3265 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1554 microversion: 2.1 time: 0.188832 Sep 19 11:24:38.318616 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 62/124] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:38 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:39.162500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:39.164042 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:39.171731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:39.172241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:39.172750 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:39.183836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:39.184583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:39.185269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:39.345509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:39.346196 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:39.357426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:39.358053 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:39.359723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:39.360565 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:39.362714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:39.363153 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:39.745271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:39.754305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-22c24f03-77cb-4fd7-af19-9007baca53d4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.595381 Sep 19 11:24:39.755469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 63/125] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:39 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:40.061023 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:40.070562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bbb76c78-035e-4a75-b1a8-365692255356 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1554 microversion: 2.1 time: 0.729227 Sep 19 11:24:40.072207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 63/126] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:39 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1554 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:40.556359 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-1e5a11ec-a462-4279-bf2b-df8c521efd06 req-0d820760-04e3-4fb4-aed8-7ce6bb3f2bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa6ead2-6eb3-4248-aa4f-76b526b373fc", "name": "network-vif-deleted", "tag": "8b1399aa-63ac-460e-a185-4338a45c416c"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:40.574298 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e5a11ec-a462-4279-bf2b-df8c521efd06 req-0d820760-04e3-4fb4-aed8-7ce6bb3f2bb3 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:40.575020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e5a11ec-a462-4279-bf2b-df8c521efd06 req-0d820760-04e3-4fb4-aed8-7ce6bb3f2bb3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:40.575614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e5a11ec-a462-4279-bf2b-df8c521efd06 req-0d820760-04e3-4fb4-aed8-7ce6bb3f2bb3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:40.588363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-1e5a11ec-a462-4279-bf2b-df8c521efd06 req-0d820760-04e3-4fb4-aed8-7ce6bb3f2bb3 service nova] Creating event network-vif-deleted:8b1399aa-63ac-460e-a185-4338a45c416c for instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc on hv-cinder-82099 Sep 19 11:24:40.594951 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-1e5a11ec-a462-4279-bf2b-df8c521efd06 req-0d820760-04e3-4fb4-aed8-7ce6bb3f2bb3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048019 Sep 19 11:24:40.604643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 64/127] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:40.777044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:40.778261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:40.781448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:40.786555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:40.788089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:40.788717 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:40.790733 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:40.791202 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:40.791637 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:41.038680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:41.047331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-20c6ed41-f1c4-4944-b7de-2c30582e0964 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.274229 Sep 19 11:24:41.048043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 64/128] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:40 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:41.095125 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:41.095841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:41.102902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:41.103566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:41.104169 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:41.105410 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:41.106124 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:41.106716 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:41.178250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:41.194265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e58d3a7d-b463-48da-9edb-033446db7d4e tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1345 microversion: 2.1 time: 0.103374 Sep 19 11:24:41.194857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 65/129] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:41 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:42.071399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:42.072614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:42.079937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:42.080430 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:42.080870 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:42.081595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:42.082183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:42.082614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:42.218614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:42.219171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:42.220909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:42.225599 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:42.226078 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:42.226508 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:42.227230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:42.227867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:42.228451 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:42.230073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a7e248f9-c4ba-4671-aa06-c79701f7b69d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.163738 Sep 19 11:24:42.231111 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 65/130] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:42 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:42.308476 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:42.318357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-dc4e225c-f6fd-42e8-b086-81119cdfff3c tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1345 microversion: 2.1 time: 0.104275 Sep 19 11:24:42.319133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 66/131] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:42 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:43.252739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:43.253466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:43.259632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:43.260236 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:43.260739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:43.261492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:43.262013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:43.262567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:43.342214 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:43.342912 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:43.350790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:43.351919 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:43.353341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:43.354576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:43.355041 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:43.356887 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:43.420075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:43.427797 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-807d431c-d52c-4ec2-a6e9-432c35b3e521 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.179198 Sep 19 11:24:43.428363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 66/132] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:43 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:43.435582 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:43.443819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1c857e66-8050-4b6f-af0d-69fcb418e91a tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1345 microversion: 2.1 time: 0.105617 Sep 19 11:24:43.444452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 67/133] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:43 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:44.449983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:44.450590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:44.456486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:44.456967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:44.457403 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:44.458082 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:44.458801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:44.459224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:44.466178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:44.466816 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:44.473218 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:44.473699 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:44.474141 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:44.474820 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:44.475272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:44.475695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:44.507023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:44.507411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:44.507871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:44.508313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lazy-loading 'fault' on Instance uuid 6aa6ead2-6eb3-4248-aa4f-76b526b373fc {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:24:44.559376 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aada82b4250745ab956466f29d1ddfb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fd848b22f854563a0ab63ec0971b595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:44.567555 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-98de5c77-e4ae-4ead-a60e-5646080c3206 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 200 len: 1350 microversion: 2.1 time: 0.105108 Sep 19 11:24:44.568161 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 68/134] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:44 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 1350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:44.625506 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:44.633670 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6b34b3e9-f623-4f46-815f-9c6cc4a0baac tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.187467 Sep 19 11:24:44.634244 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 67/135] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:44 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:45.590941 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:45.591837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:45.598618 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:45.599126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:45.599689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:45.600426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:45.600914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:45.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:45.622426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] HTTP exception thrown: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Request method failure captured: Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc HTTP/1.1 Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE2pC_NuZaKAPpqygvkckdQLvnIyUQgy9HKvxRRsGhcOj7m7mBZMY2sO6pnEpHvJFRpKUwEtLURRqlST71T5QQg-v2Yz_XVTWjLCNQP4W2MQSE7wclNB8-KPlJRARPzrkztX4iVvlCMMpna_cI8Q-PEtSkHEPbOVy8Ck6Dlt3cfgCo Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:24:45.627337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8fd848b22f854563a0ab63ec0971b595", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}] Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: aada82b4250745ab956466f29d1ddfb1 Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.628915 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '6aa6ead2-6eb3-4248-aa4f-76b526b373fc'} Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:45.629741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.630862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.631879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Returning 404 to user: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:45.631879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-42213156-3969-4785-99ba-a831ea87efe5 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 404 len: 111 microversion: 2.1 time: 0.042239 Sep 19 11:24:45.631879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 69/136] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:45 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:24:45.658505 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:45.658970 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:45.668793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:45.669462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:45.670059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:45.670764 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:45.671226 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:45.671658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:45.829091 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:45.831999 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:45.839973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:45.840653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:45.841379 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:45.842939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:45.843658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:45.844317 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:45.861907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] HTTP exception thrown: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Request method failure captured: Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc/os-volume_attachments HTTP/1.1 Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE2pC_NuZaKAPpqygvkckdQLvnIyUQgy9HKvxRRsGhcOj7m7mBZMY2sO6pnEpHvJFRpKUwEtLURRqlST71T5QQg-v2Yz_XVTWjLCNQP4W2MQSE7wclNB8-KPlJRARPzrkztX4iVvlCMMpna_cI8Q-PEtSkHEPbOVy8Ck6Dlt3cfgCo Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:24:45.864356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8fd848b22f854563a0ab63ec0971b595", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}] Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: aada82b4250745ab956466f29d1ddfb1 Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.865719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'server_id': '6aa6ead2-6eb3-4248-aa4f-76b526b373fc'} Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:45.866663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:45.868325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:45.870286 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Returning 404 to user: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:45.871416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-56646d49-369a-4a3f-a57d-a11e974cc7e9 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048278 Sep 19 11:24:45.872592 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 70/137] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:24:45 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:24:45.883994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:45.895046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d6d65f8b-7d41-4106-9a73-51b832cec017 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.240490 Sep 19 11:24:45.896233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 68/138] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:45 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:46.918911 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:46.919522 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:46.926116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:46.926507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:46.926944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:46.927629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:46.928141 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:46.928539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:47.062226 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:47.069916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d94fd7e2-d98f-48f2-8bfe-c2a2d7d395de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.154951 Sep 19 11:24:47.070486 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 71/139] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:46 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:47.241880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:47.242258 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:47.248642 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:47.249129 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:47.249567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:47.250254 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:47.250703 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:47.251128 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:47.264864 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] HTTP exception thrown: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Request method failure captured: Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc HTTP/1.1 Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE2pC_NuZaKAPpqygvkckdQLvnIyUQgy9HKvxRRsGhcOj7m7mBZMY2sO6pnEpHvJFRpKUwEtLURRqlST71T5QQg-v2Yz_XVTWjLCNQP4W2MQSE7wclNB8-KPlJRARPzrkztX4iVvlCMMpna_cI8Q-PEtSkHEPbOVy8Ck6Dlt3cfgCo Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:24:47.269463 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8fd848b22f854563a0ab63ec0971b595", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}] Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: aada82b4250745ab956466f29d1ddfb1 Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.270937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '6aa6ead2-6eb3-4248-aa4f-76b526b373fc'} Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:47.271896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.273448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.275043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Returning 404 to user: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:47.275043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c365331c-794b-413a-b47c-b888cf0dbcdf tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "DELETE /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 404 len: 111 microversion: 2.1 time: 0.033078 Sep 19 11:24:47.275043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 69/140] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:24:47 2022] DELETE /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:24:47.280144 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:47.280897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] [instance: 6aa6ead2-6eb3-4248-aa4f-76b526b373fc] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:47.286884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:47.287371 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:47.287845 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:47.288531 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:47.289092 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:47.289411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:47.304130 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] HTTP exception thrown: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Request method failure captured: Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc HTTP/1.1 Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE2pC_NuZaKAPpqygvkckdQLvnIyUQgy9HKvxRRsGhcOj7m7mBZMY2sO6pnEpHvJFRpKUwEtLURRqlST71T5QQg-v2Yz_XVTWjLCNQP4W2MQSE7wclNB8-KPlJRARPzrkztX4iVvlCMMpna_cI8Q-PEtSkHEPbOVy8Ck6Dlt3cfgCo Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:24:47.305667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8fd848b22f854563a0ab63ec0971b595", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8fd848b22f854563a0ab63ec0971b595"}]}] Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 8fd848b22f854563a0ab63ec0971b595 Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-DeleteServersTestJSON-238393775 Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: aada82b4250745ab956466f29d1ddfb1 Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-DeleteServersTestJSON-238393775-project Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.307534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '6aa6ead2-6eb3-4248-aa4f-76b526b373fc'} Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:47.308383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. Sep 19 11:24:47.309842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:24:47.311723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] Returning 404 to user: Instance 6aa6ead2-6eb3-4248-aa4f-76b526b373fc could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:47.312596 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-28f96b45-73e3-4099-8dc7-2486c06f7499 tempest-DeleteServersTestJSON-238393775 tempest-DeleteServersTestJSON-238393775-project] 10.222.0.81 "GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc" status: 404 len: 111 microversion: 2.1 time: 0.036546 Sep 19 11:24:47.313329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 72/141] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:47 2022] GET /compute/v2.1/servers/6aa6ead2-6eb3-4248-aa4f-76b526b373fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:24:48.093297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:48.094109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:48.100055 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:48.100547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:48.100985 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:48.102303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:48.102769 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:48.103705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:48.515833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:48.524242 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-501301ca-7866-4d1e-b4f7-6a107a78e366 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.434890 Sep 19 11:24:48.524810 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 70/142] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:48 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:49.551100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:49.553113 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:49.563149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:49.564056 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:49.565360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:49.566575 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:49.567707 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:49.568408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:49.866879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:49.890443 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d7fa6c81-85ed-4647-b919-a71e27e883e0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.346850 Sep 19 11:24:49.894005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 73/143] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:49 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:24:50.926244 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:50.930504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:50.949151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:50.949661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:50.950107 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:50.958868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:50.959882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:50.961669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:51.400906 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:51.415814 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4defcaf8-e0b9-43d7-b57e-ce614fbacd43 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.498883 Sep 19 11:24:51.416526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 71/144] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:50 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:52.449122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:52.450534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:52.463595 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:52.464618 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:52.465054 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:52.465758 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:52.466355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:52.466765 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:52.729344 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:52.738071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cbf18567-493e-4b00-a92d-918dda8997aa tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.294093 Sep 19 11:24:52.749544 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 74/145] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:52 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:53.762861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:53.763786 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:53.778169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:53.780902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:53.782743 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:53.786886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:53.788404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:53.791468 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:54.030453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:54.041304 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-359e73a2-4ec2-4b66-8c03-967832fb3776 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.283494 Sep 19 11:24:54.049089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 72/146] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:53 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:54.977056 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-70c099b3-65aa-4afb-860a-8665bd9561b7 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5217dcd30>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:55.028538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-70c099b3-65aa-4afb-860a-8665bd9561b7 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/81eeb3a2-f0d3-4e00-a8a4-1299b94290f6" status: 200 len: 351 microversion: 2.1 time: 0.055204 Sep 19 11:24:55.029119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 75/147] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:54 2022] GET /compute/v2.1/os-volumes/81eeb3a2-f0d3-4e00-a8a4-1299b94290f6 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:55.064109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:55.064711 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:55.073867 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:55.074366 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:55.074800 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:55.075634 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:55.076126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:55.076549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:55.233033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:55.247592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d4605dee-fc39-400b-b01b-1ca232b72b2f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1521 microversion: 2.1 time: 0.187135 Sep 19 11:24:55.248636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 73/148] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:55 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:56.277141 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:56.277780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:56.284067 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:56.284561 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:56.285009 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:56.285702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:56.286203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:56.286631 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:56.303996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=100 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:56.421082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:56.428946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e07286d0-aab1-41aa-bbb4-90309e5182a7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1501 microversion: 2.1 time: 0.156148 Sep 19 11:24:56.429521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 76/149] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:56 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:56.451172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:56.452248 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:56.458828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:56.459448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:56.459948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:56.460679 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:56.461125 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:56.461592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:56.478928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-05017f0b-5bb3-4a95-9a76-60da5afab212 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5217dcaf0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:56.532745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-05017f0b-5bb3-4a95-9a76-60da5afab212 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/543f2a65-5eb1-4df8-b0df-b6eb364487b2" status: 200 len: 350 microversion: 2.1 time: 0.057722 Sep 19 11:24:56.533567 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 77/150] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:56 2022] GET /compute/v2.1/os-volumes/543f2a65-5eb1-4df8-b0df-b6eb364487b2 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:56.613977 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:56.625206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-dd73118a-d3fc-499e-a043-08a5cf83b64a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1514 microversion: 2.1 time: 0.177736 Sep 19 11:24:56.625793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 74/151] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:56 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:57.921769 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e9097930-5087-4177-a852-66b5b49fdeca tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5217d9310>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:57.975153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e9097930-5087-4177-a852-66b5b49fdeca tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/7f4d10e5-b784-4489-bfa2-7e144fe7dea5" status: 200 len: 351 microversion: 2.1 time: 0.057656 Sep 19 11:24:57.976034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 78/152] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:57 2022] GET /compute/v2.1/os-volumes/7f4d10e5-b784-4489-bfa2-7e144fe7dea5 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:57.991025 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4df09772-1643-45f8-b033-6a4872a2dd17 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5218a9e50>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.059318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:58.061946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:58.071086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:58.072259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:58.072806 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:58.073579 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:58.074233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:58.074628 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:58.098687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lazy-loading 'flavor' on Instance uuid 781f01d3-aa65-40ad-9c85-0e93e6f05745 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:24:58.108863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4df09772-1643-45f8-b033-6a4872a2dd17 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.122984 Sep 19 11:24:58.109481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 75/153] 10.222.0.81 () {58 vars in 1134 bytes} [Mon Sep 19 11:24:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:58.123834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6908d25a-a376-4158-97cc-c6e6a7d0533d tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5218c4ca0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.194938 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-037d0036-1708-467f-8357-2a3e4136373d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/action" status: 200 len: 32 microversion: 2.1 time: 0.139303 Sep 19 11:24:58.196160 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 79/154] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:24:58 2022] POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 11:24:58.214081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6908d25a-a376-4158-97cc-c6e6a7d0533d tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093821 Sep 19 11:24:58.214368 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.215179 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:58.222910 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:58.223821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:58.223933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 76/155] 10.222.0.81 () {58 vars in 1149 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:58.224131 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:58.225264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:58.228605 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:58.229272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e015cf8f-ccb9-4a81-9631-9df643fb6cdf tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5218cc0d0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.229408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:58.315828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e015cf8f-ccb9-4a81-9631-9df643fb6cdf tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090728 Sep 19 11:24:58.316420 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 77/156] 10.222.0.81 () {58 vars in 1134 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:58.330952 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1553c7d3-31a6-4d54-bad9-c082e65aef1a tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff521985040>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.429407 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1553c7d3-31a6-4d54-bad9-c082e65aef1a tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.103723 Sep 19 11:24:58.429988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 78/157] 10.222.0.81 () {58 vars in 1167 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:58.445898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-729be92a-ba1c-4cb2-9603-5594936aa9a5 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5218c4b80>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.486243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:58.498840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-440a383a-eb3f-46e9-aade-be58baacd476 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.289422 Sep 19 11:24:58.515087 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 80/158] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:58.542372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-729be92a-ba1c-4cb2-9603-5594936aa9a5 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.102401 Sep 19 11:24:58.543321 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 79/159] 10.222.0.81 () {58 vars in 1170 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:58.556980 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a10a9cb4-cc89-40f9-b4f1-32e2a38d1b6a tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5217d9ca0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.646104 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a10a9cb4-cc89-40f9-b4f1-32e2a38d1b6a tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093008 Sep 19 11:24:58.646810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 81/160] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:58.660941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8a1757d0-0655-455d-8ed4-6b8d01115a41 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5218cc8b0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.751046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8a1757d0-0655-455d-8ed4-6b8d01115a41 tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093777 Sep 19 11:24:58.751849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 80/161] 10.222.0.81 () {58 vars in 1188 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:58.765897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-098385e0-d026-4095-a52e-42475f9ef82e tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] Calling method '.version_select at 0x7ff5217dc310>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.862300 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-098385e0-d026-4095-a52e-42475f9ef82e tempest-VolumesTestJSON-1895336737 tempest-VolumesTestJSON-1895336737-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100042 Sep 19 11:24:58.867960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 82/162] 10.222.0.81 () {58 vars in 1155 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:24:59.522641 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:59.523258 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:24:59.530481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:59.530975 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:59.531414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:59.532183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:59.532727 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:59.533153 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:59.847655 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:24:59.856266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-146e0b0c-e640-4fbe-b16d-bc0a96f610ae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.337454 Sep 19 11:24:59.856847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 81/163] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:24:59 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:00.881118 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:00.881837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:00.888712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:00.889530 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:00.890198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:00.891193 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:00.892083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:00.892719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:01.042741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:01.057034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b1902e8d-ff5e-4f27-812d-f52f5fd5d7c7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.180880 Sep 19 11:25:01.057774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 83/164] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:00 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:02.080504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:02.081902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:02.089344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:02.089831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:02.090269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:02.091113 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:02.091573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:02.092040 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:02.228274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:02.235857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6e69bf03-d561-42b2-8a9b-5b8d8206f3de tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.159352 Sep 19 11:25:02.236418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 82/165] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:02 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:03.259729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:03.260375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:03.266993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:03.267714 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:03.268284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:03.269082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:03.269615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:03.270113 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:03.421738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:03.429418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9d7c9124-4cac-467c-a666-a03356cc9b2e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.174606 Sep 19 11:25:03.429987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 84/166] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:03 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:04.451871 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:04.453364 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:04.460434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:04.460876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:04.461372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:04.462573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:04.463148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:04.463437 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:04.606174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:04.613809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-83ac992f-4c8f-49ca-ae9c-98122b15557d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.165885 Sep 19 11:25:04.614373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 83/167] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:04 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:05.636446 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.637144 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:05.639570 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=42 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:05.645015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:05.645494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:05.645920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:05.646595 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:05.647040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:05.647460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:05.782579 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:05.790919 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7123e156-e83b-429e-b5a7-ad16b0002dfb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.158132 Sep 19 11:25:05.791388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 85/168] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:05 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:06.814284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:06.815285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:06.822549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:06.823042 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:06.823484 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:06.824221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:06.824685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:06.825114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:06.955595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:06.959333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:06.965509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-363f1d9b-d9c5-42c9-ac19-4bcd06f61561 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.155558 Sep 19 11:25:06.966092 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 84/169] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:06 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:07.990631 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:07.991230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:07.998075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:07.998552 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:07.998985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:07.999660 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:08.000130 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:08.000550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:08.126089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:08.134319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bab40127-28dc-42fd-b724-234a47c31b9f tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.146937 Sep 19 11:25:08.134893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 86/170] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:07 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:09.156934 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.157553 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:09.163737 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:09.164257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:09.165210 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:09.165896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:09.166356 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:09.166988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:09.302922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:09.311132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e0a2a24e-0608-4f7f-89c0-9d486c69d8e9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.158228 Sep 19 11:25:09.311696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 85/171] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:10.333689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:10.334408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:10.340807 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:10.341293 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:10.341732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:10.342413 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:10.342868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:10.343294 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:10.469537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:10.477172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a31efd5f-c23d-4056-90bf-770607c9a1cc tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.147565 Sep 19 11:25:10.477732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 87/172] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:10 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:11.498712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:11.499324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:11.501190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=32 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:11.506802 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:11.507233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:11.507674 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:11.508908 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:11.509370 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:11.509799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:11.635441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:11.643242 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f269cc7e-a84f-41f2-b2c7-25426b03b989 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.148261 Sep 19 11:25:11.643846 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 86/173] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:11 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:12.666731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:12.667347 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:12.674089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:12.674307 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:12.674741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:12.675429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:12.675908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:12.676338 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:12.806457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:12.814041 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bc815e86-eb26-4528-bcf5-dd6cc3511394 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.151586 Sep 19 11:25:12.814607 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 88/174] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:12 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:13.838082 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:13.838800 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:13.844662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:13.845151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:13.845592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:13.846307 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:13.846771 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:13.847191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:13.978161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:13.985792 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a322c716-940f-4e7d-a85a-730d4210d545 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.152525 Sep 19 11:25:13.986350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 87/175] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:13 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:15.009304 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:15.009917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:15.016532 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:15.017068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:15.017541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:15.018116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:15.018574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:15.019000 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:15.159400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:15.167642 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-17cf5ae2-3d1c-49a8-afbf-46da8a621934 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.162764 Sep 19 11:25:15.168276 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 89/176] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:15 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:16.196472 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:16.197158 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:16.203993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:16.204401 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:16.204849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:16.205547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:16.206010 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:16.206443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:16.366205 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:16.373986 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2a3d2fc2-a685-4c88-bcaf-cf3e2f526db6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.181607 Sep 19 11:25:16.374569 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 88/177] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:16 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:17.407444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:17.408407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:17.416795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:17.417526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:17.417967 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:17.418673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:17.419131 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:17.419565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:17.573667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:17.590206 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2fcfe77e-8ee6-4eaf-b84f-aa8eedfbb1a9 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.186349 Sep 19 11:25:17.591069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 90/178] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:17 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:18.616915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:18.618042 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:18.624018 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.624510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.624948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.625640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.626131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.626566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.766412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:18.774566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0ba4f0a0-e99e-429a-909d-754c7fd76728 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1500 microversion: 2.1 time: 0.161249 Sep 19 11:25:18.775479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 89/179] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:18 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1500 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:18.797110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "389005e9-8265-4eb4-b5a3-8a24aa506508"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:18.799718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:18.806052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.806532 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.806964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.807651 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.808160 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.809900 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.834300 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] HTTP exception thrown: Cannot 'attach_volume' instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 while it is in vm_state rescued Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Request method failure captured: Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/os-volume_attachments HTTP/1.1 Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 74 Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE719UvpezPNvQaaanqD4PcCWo6l7Ntm0rvI7ztghwwneiFW7ghElnLw9QbHp-IlsoDFFdAPcvtvYgjLrXmu5JnecRrD4N6situzQJt9sGXI3kLio4zbKRcoF9TxyIas68Ga33TugbFY3Kwz6QLzMiSSTLbBn4Mqh-aautQRHBERFo Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:25:18.836829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c7ccdce201f547f5a50c93e27c5e8cb1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}] Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 9f160368e1984319ad4fa37c2794a956 Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {"volumeAttachment": {"volumeId": "389005e9-8265-4eb4-b5a3-8a24aa506508"}} Sep 19 11:25:18.838094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Cannot 'attach_volume' instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 while it is in vm_state rescued Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'server_id': '781f01d3-aa65-40ad-9c85-0e93e6f05745', 'body': {'volumeAttachment': {'volumeId': '389005e9-8265-4eb4-b5a3-8a24aa506508'}}} Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:25:18.838837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 while it is in vm_state rescued Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:18.840155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:18.841382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:25:18.841382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:25:18.841382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 while it is in vm_state rescued Sep 19 11:25:18.841382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:25:18.841382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Returning 409 to user: Cannot 'attach_volume' instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 while it is in vm_state rescued {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:25:18.841382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1ddbee9f-fa5c-43f5-a764-d8dc8cdbf174 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045130 Sep 19 11:25:18.843929 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 91/180] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:25:18 2022] POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:25:18.847259 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:18.847897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:18.861969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.861969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.861969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.861969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.862305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.862305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.934860 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1c21bd00-2507-496b-a1de-760e3708d24e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/action" status: 202 len: 0 microversion: 2.1 time: 0.091158 Sep 19 11:25:18.935587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 90/181] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:25:18 2022] POST /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:25:18.943602 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:18.944326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:18.951178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.951968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.952407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.953374 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.953886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.954308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:19.184831 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:19.192455 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4daa12b4-758c-4d02-9d7f-560ad316c170 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1508 microversion: 2.1 time: 0.252642 Sep 19 11:25:19.193040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 92/182] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:18 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1508 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:20.217139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:20.217866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:20.224357 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:20.224862 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:20.225304 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:20.226001 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:20.226459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:20.227473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:20.360749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:20.369133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b2802bca-f007-48c1-9662-7edd4bc6e7f5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1508 microversion: 2.1 time: 0.156286 Sep 19 11:25:20.369690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 91/183] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:20 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:21.392113 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:21.392762 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:21.399671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.400208 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.400652 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.401346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.401804 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.402233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.547028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:21.555879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f249de47-84d1-42a0-b68e-64c6ec478a2d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1508 microversion: 2.1 time: 0.167987 Sep 19 11:25:21.556491 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 93/184] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:21 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:22.583555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:22.585037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:22.592386 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:22.592880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:22.593322 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:22.594027 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:22.594488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:22.595147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:22.778489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:22.790618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-570de394-9f5e-400a-851c-198528b3668a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1514 microversion: 2.1 time: 0.214252 Sep 19 11:25:22.791793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 92/185] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:22 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:24.213979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8edf829a-caab-4312-8209-af5221bfda60 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'create', calling method: .version_select at 0x7ff521795d30>, body: {"keypair": {"name": "tempest-keypair-604998255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaDOHLEMAkO1tez2wZW/IQ+6CG07HEJdhI3SZC7QFnyRMGGUGbgIBq02BlkYPEgusCFDCmy2bt8rQUBFDqrBKWYm1p92ascgiy4VrzE32GlqvZL8bn1+4O7mJrG9loIBA=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:24.236228 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-8edf829a-caab-4312-8209-af5221bfda60 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:24.241975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-8edf829a-caab-4312-8209-af5221bfda60 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for user 9f160368e1984319ad4fa37c2794a956 and project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:24.281334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8edf829a-caab-4312-8209-af5221bfda60 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071706 Sep 19 11:25:24.281946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 94/186] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:25:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:25.514940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-591893378", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f760d48-3e02-4562-abc4-dc5b172f3b8a"}], "security_groups": [{"name": "tempest-securitygroup--593790591"}], "key_name": "tempest-keypair-604998255", "user_data": "}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:25.618680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] validate_networks() for [('8f760d48-3e02-4562-abc4-dc5b172f3b8a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:25:25.987876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:25:25.988310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:25:25.988788 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:25:25.989234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:25:25.989690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:25:25.998885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:25.999375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:25.999842 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.000576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.001038 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.001472 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.018228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:26.022172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Getting quotas for user 9f160368e1984319ad4fa37c2794a956 and project c7ccdce201f547f5a50c93e27c5e8cb1. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:26.033075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:25:26.035355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:25:26.082046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-770b52a3-2a92-4a00-ba38-2eae234aa578 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.571311 Sep 19 11:25:26.082694 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 93/187] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:25:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:25:26.094868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4a6b0127-f94c-4599-8bf6-85c2ff0bac5e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:26.095477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4a6b0127-f94c-4599-8bf6-85c2ff0bac5e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:26.147329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4a6b0127-f94c-4599-8bf6-85c2ff0bac5e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:26.155429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4a6b0127-f94c-4599-8bf6-85c2ff0bac5e tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1244 microversion: 2.1 time: 0.064851 Sep 19 11:25:26.156017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 95/188] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:26 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1244 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:27.178369 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:27.178945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:27.184943 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:27.185435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:27.185876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.186563 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:27.187022 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:27.187467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.246685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:27.254187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7e6c2a62-d329-4387-9e8c-9aa8147e7272 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1296 microversion: 2.1 time: 0.079776 Sep 19 11:25:27.254750 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 94/189] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:27 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1296 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:28.278611 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:28.279205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:28.286031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.286528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.286963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.287666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.288223 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.288652 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.291654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:28.544324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:28.552024 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c0bd31e2-8728-453d-987c-77f149ef7401 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.277320 Sep 19 11:25:28.552729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 96/190] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:28 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:29.475789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-ada3783d-d869-4a51-bd37-2aebbdf647f4 req-c11cdc48-2eff-4477-b9fb-4093c092096a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be205d-fa54-491f-87bf-159cda85b1c3", "tag": "7caf44f4-6ec4-453f-b026-5ce545b8b513"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:29.486953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-ada3783d-d869-4a51-bd37-2aebbdf647f4 req-c11cdc48-2eff-4477-b9fb-4093c092096a service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.487530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-ada3783d-d869-4a51-bd37-2aebbdf647f4 req-c11cdc48-2eff-4477-b9fb-4093c092096a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.488198 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-ada3783d-d869-4a51-bd37-2aebbdf647f4 req-c11cdc48-2eff-4477-b9fb-4093c092096a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.499276 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-ada3783d-d869-4a51-bd37-2aebbdf647f4 req-c11cdc48-2eff-4477-b9fb-4093c092096a service nova] Creating event network-changed:7caf44f4-6ec4-453f-b026-5ce545b8b513 for instance e6be205d-fa54-491f-87bf-159cda85b1c3 on hv-cinder-82099 Sep 19 11:25:29.504016 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-ada3783d-d869-4a51-bd37-2aebbdf647f4 req-c11cdc48-2eff-4477-b9fb-4093c092096a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033020 Sep 19 11:25:29.504605 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 95/191] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:29.575479 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:29.576041 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:29.585054 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.585678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.586180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.586934 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.587451 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.587966 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.918889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:29.926718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bc6f78e8-c71d-4bf3-9b32-c49fd137560c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.355191 Sep 19 11:25:29.927319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 97/192] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:29 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:30.866781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:30.866781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:30.873510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.873996 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.874437 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.875127 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.875585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.876045 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.898589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4c0b99ee-d13c-4d6a-8a57-bcaa17b41bad tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/ips" status: 200 len: 146 microversion: 2.1 time: 0.036533 Sep 19 11:25:30.899086 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 96/193] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:25:30 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:30.949737 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:30.950337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:30.956603 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.957082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.957511 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.958477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.958921 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.959336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:31.087677 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:31.095461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-68da9b9f-6a21-497a-8932-fbde448c05d8 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.149440 Sep 19 11:25:31.096023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 98/194] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:30 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:32.034482 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:32.035033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:32.041002 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.041486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.041924 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.042604 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.043057 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.043490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.067630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8251fd8c-deae-4acd-87a4-e9c21ebb3093 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/ips" status: 200 len: 151 microversion: 2.20 time: 0.036996 Sep 19 11:25:32.068391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 97/195] 10.222.0.81 () {60 vars in 1289 bytes} [Mon Sep 19 11:25:32 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:25:32.120105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:32.120726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:32.127571 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.128264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.128762 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.129467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.129929 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.130354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.392071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:32.414839 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d4eb19b1-01d3-42c6-ba0e-44536d5f53c2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.300651 Sep 19 11:25:32.415614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 99/196] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:32 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:33.439688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:33.440424 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:33.446861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.447351 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.447814 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.448689 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.449145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.449574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.584161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:33.592591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6afbeca1-f12f-474b-aad8-564eeb065468 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.156738 Sep 19 11:25:33.593168 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 98/197] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:33 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:34.163722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:34.164275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:34.171791 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.172626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.173408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.174458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.175133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.175784 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.199947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lazy-loading 'flavor' on Instance uuid 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:25:34.408179 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-dad6374c-84b8-46f9-b571-e5c02e24fe08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/action" status: 202 len: 0 microversion: 2.20 time: 0.247919 Sep 19 11:25:34.408835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 100/198] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 11:25:34 2022] POST /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:25:34.418633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:34.419259 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:34.425341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.425832 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.426274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.427189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.427652 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.428128 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.615538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:34.616276 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:34.622590 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.623289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.623504 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.624330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.624856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.625282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.656449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.667348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.668847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.670028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-81ac8208-6237-450d-8370-c8ecbff37523 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.256190 Sep 19 11:25:34.670816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 99/199] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:34 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:34.782186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.790924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b4f62a53-8ffc-4d21-9b11-fbebe9b9aac0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.179559 Sep 19 11:25:34.791511 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 101/200] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:34 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:35.700060 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:35.700538 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:35.731068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.731888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.732519 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.733422 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.733887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.734321 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.813397 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:35.814645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:35.821423 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:35.833718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.834697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.835848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.836763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.837378 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.838941 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.937398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:35.947662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:35.949957 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:35.957449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-98f531d2-7641-4783-869c-42697030f06c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.257830 Sep 19 11:25:35.972341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 100/201] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:35 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:36.014536 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:36.022251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-44542684-b382-4ba0-89df-3a90c77baa9d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.212739 Sep 19 11:25:36.023717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 102/202] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:35 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:36.248109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d088c8b-b9e2-467e-b7cf-5c7904ad0bf5"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:36.251163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:36.253366 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.254022 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:36.261577 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:36.262063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:36.262502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:36.263200 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:36.263652 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:36.264101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:36.987238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:36.989122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:36.998501 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:37.003178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.004554 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.007926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.008898 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.010171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.010610 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.149786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.159228 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.160947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.162278 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a6fe409a-dc95-437e-ac2b-dd5676a6ce18 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.180615 Sep 19 11:25:37.163455 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 103/203] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:36 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:37.168030 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:37.168794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:37.174821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.175495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.176121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.177064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.177673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.178250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.337882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.351811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8c1a2275-2b3a-4426-b877-2a220334233d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.183151 Sep 19 11:25:37.352760 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 104/204] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:37 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:38.188569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:38.189467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:38.197438 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.198293 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.198949 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.199726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.200418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.200921 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.358495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:38.375319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:38.376782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:38.377943 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-407d901d-ea29-48e0-a0fa-1ca808731e0c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.193365 Sep 19 11:25:38.378499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 105/205] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:38 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:38.383351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:38.384469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:38.390808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.391508 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.392159 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.393001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.393620 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.394191 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.550893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:38.560485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6ec35893-736a-4934-be32-0207687bd8f2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.180721 Sep 19 11:25:38.561430 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 106/206] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:38 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:39.095251 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:39.125691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3499ff6e-9c66-4b3e-aead-032b57f8478b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.881431 Sep 19 11:25:39.127234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 101/207] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:25:36 2022] POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-volume_attachments => generated 194 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:39.409849 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:39.410625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:39.418095 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.418747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.419431 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.420227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.420870 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.421894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.585780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:39.586489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:39.603278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.604083 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.604813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.606384 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.607063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.608164 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.636711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:39.653165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:39.660306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:39.662121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-74cbea14-b2a3-435e-a8c8-7c52a6599839 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.260379 Sep 19 11:25:39.662694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 107/208] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:39 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:39.850075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:39.862429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6ba1d388-b45e-4f46-83d9-ad4529ec6429 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.281431 Sep 19 11:25:39.863049 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 102/209] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:39 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:40.048163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-f19d1a4f-4887-4b7d-a0c7-a1aaab212f31 req-f759c8b0-a0de-4d38-ba45-0d23dd81f80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6be205d-fa54-491f-87bf-159cda85b1c3", "name": "network-vif-plugged", "status": "completed", "tag": "7caf44f4-6ec4-453f-b026-5ce545b8b513"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:40.067881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-f19d1a4f-4887-4b7d-a0c7-a1aaab212f31 req-f759c8b0-a0de-4d38-ba45-0d23dd81f80e service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.068659 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-f19d1a4f-4887-4b7d-a0c7-a1aaab212f31 req-f759c8b0-a0de-4d38-ba45-0d23dd81f80e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.073545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-f19d1a4f-4887-4b7d-a0c7-a1aaab212f31 req-f759c8b0-a0de-4d38-ba45-0d23dd81f80e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.089775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-f19d1a4f-4887-4b7d-a0c7-a1aaab212f31 req-f759c8b0-a0de-4d38-ba45-0d23dd81f80e service nova] Creating event network-vif-plugged:7caf44f4-6ec4-453f-b026-5ce545b8b513 for instance e6be205d-fa54-491f-87bf-159cda85b1c3 on hv-cinder-82099 Sep 19 11:25:40.106433 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-f19d1a4f-4887-4b7d-a0c7-a1aaab212f31 req-f759c8b0-a0de-4d38-ba45-0d23dd81f80e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063756 Sep 19 11:25:40.109836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 108/210] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:40.691224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:40.691955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:40.699073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.709962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.716552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.717502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.718131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.718851 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.888758 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:40.889763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:40.902423 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.905996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.912856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.913913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.914548 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.915560 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.944476 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:40.955220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:40.964426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:40.970486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-31f6849f-62f3-40a6-9755-c88f53378845 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.283310 Sep 19 11:25:40.971090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 103/211] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:40 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:41.091497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:41.099180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2abd22b5-ee72-4d26-8856-a6952ca8d07c tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.216714 Sep 19 11:25:41.100094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 109/212] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:40 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:42.002013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:42.004514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:42.013082 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:42.015955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.016625 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.017395 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.018449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.019266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.020044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.122688 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:42.124137 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:42.155053 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.156793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.157450 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.158353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.159702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.160415 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.307207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.323679 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.328409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.329904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-212346c5-0fdd-43cd-a32c-c2a8ac61457a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.336961 Sep 19 11:25:42.349523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 104/213] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:41 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:42.467122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.479201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-57a6ecd0-48c9-43e0-afaa-a0b8485dfe87 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1369 microversion: 2.1 time: 0.360343 Sep 19 11:25:42.480565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 110/214] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:42 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1369 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:43.361798 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:43.363398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:43.387077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.387812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.388434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.389335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.390948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.391415 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.503653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:43.504306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:43.519984 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.528116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.529679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.530827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.532153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.532697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.576874 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:43.829586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:43.843029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:43.846255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:43.848049 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c9bfa8db-066c-4f15-912e-a510d319ad2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.491157 Sep 19 11:25:43.848845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 105/215] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:43 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:43.871115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:43.887477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a89cabae-195d-417b-9d48-5edcdfbda1bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1562 microversion: 2.1 time: 0.388254 Sep 19 11:25:43.888671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 111/216] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:43 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1562 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:43.911031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:43.911937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:43.918828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.919560 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.920252 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.921216 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.921760 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.922254 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:44.017461 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8978b1c3-258a-419f-a5bd-29afdaa80af7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110106 Sep 19 11:25:44.017801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 106/217] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:25:43 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:44.356123 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3e0426fc-68d8-4cb7-bccc-7a16b200433b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Action: 'create', calling method: .version_select at 0x7ff5217d2700>, body: {"keypair": {"name": "tempest-TestShelveInstance-375660481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFF8QlWirykkA45vElcugtSr6qJK1rBFNctVIYft/U8CIgYWnRjjLdKsW+0tdJnm0uHOFijiltDXze0pK5n+W7bPECStXb100d24cFnyFRtwlPEB+w++/jvk5FrYqSJmw=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:44.376023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-3e0426fc-68d8-4cb7-bccc-7a16b200433b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Getting quotas for project 221fd300d74c4248a1bfc9b785476477. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:44.380749 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-3e0426fc-68d8-4cb7-bccc-7a16b200433b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Getting quotas for user 6e8793d50fce45f08c0c4000b7ae75e4 and project 221fd300d74c4248a1bfc9b785476477. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:44.410431 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3e0426fc-68d8-4cb7-bccc-7a16b200433b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.266760 Sep 19 11:25:44.411183 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 112/218] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:25:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:44.877341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:44.877956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:44.887777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:44.888694 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:44.892841 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:44.895402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:44.900020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:44.900306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.111363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:45.122929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:45.125141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:45.126347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-42eb5677-eaa9-489f-af04-20f0a8e5e9e5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.253479 Sep 19 11:25:45.128972 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 107/219] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:44 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:45.180961 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-7e8b63c9-7d3d-40fa-9bc1-5e5eec6607ed req-d7546a50-89f6-49db-871f-f384f8da21e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be205d-fa54-491f-87bf-159cda85b1c3", "tag": "7caf44f4-6ec4-453f-b026-5ce545b8b513"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:45.206823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-7e8b63c9-7d3d-40fa-9bc1-5e5eec6607ed req-d7546a50-89f6-49db-871f-f384f8da21e3 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.207601 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-7e8b63c9-7d3d-40fa-9bc1-5e5eec6607ed req-d7546a50-89f6-49db-871f-f384f8da21e3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.208581 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-7e8b63c9-7d3d-40fa-9bc1-5e5eec6607ed req-d7546a50-89f6-49db-871f-f384f8da21e3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.224360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-7e8b63c9-7d3d-40fa-9bc1-5e5eec6607ed req-d7546a50-89f6-49db-871f-f384f8da21e3 service nova] Creating event network-changed:7caf44f4-6ec4-453f-b026-5ce545b8b513 for instance e6be205d-fa54-491f-87bf-159cda85b1c3 on hv-cinder-82099 Sep 19 11:25:45.229933 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-7e8b63c9-7d3d-40fa-9bc1-5e5eec6607ed req-d7546a50-89f6-49db-871f-f384f8da21e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053245 Sep 19 11:25:45.231374 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 113/220] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:25:46.154948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:46.155734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:46.164226 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.165135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.165679 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.166534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.167372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.169359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.385751 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:46.395682 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:46.397173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:46.399910 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-49f2f06e-88da-4148-a290-3f70faaaa640 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.248982 Sep 19 11:25:46.401252 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 108/221] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:46 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:46.990296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-87d0b6a4-c361-4db0-b09f-7b2679539a4c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:46.997940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87d0b6a4-c361-4db0-b09f-7b2679539a4c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.998585 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87d0b6a4-c361-4db0-b09f-7b2679539a4c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.999071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-87d0b6a4-c361-4db0-b09f-7b2679539a4c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.065477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-87d0b6a4-c361-4db0-b09f-7b2679539a4c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Going to try to stop instance {{(pid=120458) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 11:25:47.248713 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-87d0b6a4-c361-4db0-b09f-7b2679539a4c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.262766 Sep 19 11:25:47.249653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 114/222] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:25:46 2022] POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:25:47.261390 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:47.262013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:47.269359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.269892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.270394 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.271269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.273192 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.274445 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.420192 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.428700 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5fee7a36-5347-43e2-a9e8-07acd5806720 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.174448 Sep 19 11:25:47.429368 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 109/223] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:47 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:47.430692 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:47.431485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:47.438280 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.438998 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.439508 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.440445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.440963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.441361 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.587468 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.595717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.597188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.598346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-27ff64b6-eb6b-4468-ba57-615bf4f80934 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.172454 Sep 19 11:25:47.607892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 115/224] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:47 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:48.453324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:48.453887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:48.462661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.463188 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.463629 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.464363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.464818 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.465346 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.596265 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:48.605174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b8b5b9b4-027d-41b2-ab46-40479c35176b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.155810 Sep 19 11:25:48.605735 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 110/225] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:48 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:48.625272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:48.625902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:48.632857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.633347 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.633794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.634479 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.634937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.635363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.773706 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:48.781815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:48.783276 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:48.784548 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-029afa94-a3f1-4b2f-a910-496f640f0ec3 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.163152 Sep 19 11:25:48.785105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 116/226] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:48 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:49.628728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:49.629339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:49.636257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.636733 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.637167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.637846 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.638301 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.638718 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.781140 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.791089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-21e00f13-ff36-4555-83bc-5902952974a0 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.165957 Sep 19 11:25:49.792516 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 111/227] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:49 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:49.810761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:49.823568 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:49.830304 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.830801 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.831248 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.831961 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.832418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.833094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.982716 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.992855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.994311 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.995488 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-59759a35-fe39-4ebd-b2df-5253c4190d52 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.189308 Sep 19 11:25:49.996075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 117/228] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:49 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:50.816614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:50.817778 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:50.825786 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.826501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.827121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.828005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.828473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.828901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.960042 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:50.968165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6ed19f6b-1c06-471d-a289-d04674414327 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.155702 Sep 19 11:25:50.968718 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 112/229] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:50 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:51.024107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:51.024744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:51.032312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.032809 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.033253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.034032 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.034551 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.035094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.175842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:51.185401 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:51.187139 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:51.188407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e45fa5b1-e5bd-4cb9-87ce-3f5ac297fa07 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.172026 Sep 19 11:25:51.188964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 118/230] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:51 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:51.993305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:51.993829 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:52.000194 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.000684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.001126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.001819 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.002343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.002873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.135299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:52.144310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-299d0c2c-beda-4844-bf5b-29850e6926fa tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.155461 Sep 19 11:25:52.144900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 113/231] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:51 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:52.214555 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:52.215166 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:52.221623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.222115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.222572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.223246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.224001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.224440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.354736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:52.364132 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:52.365706 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:52.367717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-60dad115-0524-4ffd-b66d-d0e19d0dc319 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1743 microversion: 2.20 time: 0.157084 Sep 19 11:25:52.368297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 119/232] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:52 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:53.168448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:53.168995 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:53.175414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.175942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.176379 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.177061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.177515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.177941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.393937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:53.394611 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:53.402222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.402775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.403215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.403951 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.404408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.404836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.540445 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:53.557975 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-87eef9a4-8a8b-42c6-8f36-631b25479d7c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.393411 Sep 19 11:25:53.558738 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 114/233] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:53 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:53.630324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:53.638976 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:53.640664 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:53.641836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f37621a2-2530-44bf-9261-b73892a9189b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1743 microversion: 2.20 time: 0.252019 Sep 19 11:25:53.642396 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 120/234] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:53 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1743 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:54.585239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:54.586716 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:54.593946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:54.594747 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:54.595406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.596515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:54.597240 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:54.597904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.669339 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:54.669957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:54.672239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=4 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:54.682815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:54.683308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:54.683742 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.684465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:54.684916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:54.685363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.854347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.863668 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3400ee35-bfb3-46c6-ab3f-df829aa161b4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.285427 Sep 19 11:25:54.867608 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 115/235] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:54 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:54.940761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.952380 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.956931 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.960224 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-0dd9ca7a-7219-4ec9-9aac-7360f9c4c5f2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.294828 Sep 19 11:25:54.961403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 121/236] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:54 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:55.731978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-98799d28-a584-486c-b2dc-f88870bad769 req-7f32754d-0611-4d4e-90a7-c28f93c83443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "name": "network-vif-plugged", "status": "completed", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:55.747869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-98799d28-a584-486c-b2dc-f88870bad769 req-7f32754d-0611-4d4e-90a7-c28f93c83443 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.748572 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-98799d28-a584-486c-b2dc-f88870bad769 req-7f32754d-0611-4d4e-90a7-c28f93c83443 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.749307 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-98799d28-a584-486c-b2dc-f88870bad769 req-7f32754d-0611-4d4e-90a7-c28f93c83443 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.761919 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-98799d28-a584-486c-b2dc-f88870bad769 req-7f32754d-0611-4d4e-90a7-c28f93c83443 service nova] Creating event network-vif-plugged:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:25:55.767228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-98799d28-a584-486c-b2dc-f88870bad769 req-7f32754d-0611-4d4e-90a7-c28f93c83443 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038995 Sep 19 11:25:55.768056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 116/237] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:55.894470 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:55.895082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:55.902783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.903641 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.904353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.905350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.905805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.906263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.988460 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:55.989172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:55.995948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.996446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.996898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.997586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.998043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.998475 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.112523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.123098 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1bf97099-1621-4bae-b9b0-4035d60a45c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.232310 Sep 19 11:25:56.139745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 122/238] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:55 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:56.281311 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.296154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.297627 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.298816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7a015a7f-c873-40f8-8892-ec31112827ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.314783 Sep 19 11:25:56.305342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 117/239] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:55 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:57.154968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:57.156530 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:57.163127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.164048 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.164700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.165635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.166312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.166917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.331664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:57.341059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:57.361567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.362064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.362502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.363206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.363661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.364106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.427939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:57.443035 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-348518e5-b9a1-45ca-b363-214ded6141a5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.292334 Sep 19 11:25:57.443628 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 123/240] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:57 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:57.595878 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:57.601689 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:57.607420 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:57.608897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:57.611862 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-efc30e10-61b7-4727-84b5-dc989041e4bd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.284087 Sep 19 11:25:57.628418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 118/241] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:57 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:25:58.469147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:58.470070 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:58.479362 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:58.480409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:58.481003 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.484924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:58.485604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:58.486236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.640579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:58.642029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:58.653347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:58.658788 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:58.659632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.660814 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:58.661617 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:58.662548 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.705992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.718242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-91ee2e96-3155-4edb-af9f-27dd16455de5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.253589 Sep 19 11:25:58.723543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 124/242] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:58 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:58.819623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.828031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.829507 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.830756 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-29549d80-600a-4923-80a2-95ca6f5c1faf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.195328 Sep 19 11:25:58.831356 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 119/243] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:58 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:25:59.746617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:59.747791 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:59.768334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.768857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.769290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.770000 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.770463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.770905 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.868894 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:59.870155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:59.884692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.887024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.888653 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.889726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.891021 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.893096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.016960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:00.028210 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-49a08aa1-f4bd-469c-b70f-ed6150627207 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.285632 Sep 19 11:26:00.043796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 125/244] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:59 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:00.095639 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:00.104235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:00.105799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:00.107222 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-89a1253f-6afa-4d97-b6c3-37f24fd52db8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.251468 Sep 19 11:26:00.108204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 120/245] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:25:59 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:01.053933 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:01.055381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:01.062370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:01.063179 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:01.063909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:01.064845 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:01.065535 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:01.066161 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:01.132906 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:01.133835 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:01.149123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:01.150004 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:01.150694 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:01.151499 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:01.152383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:01.154474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:01.229860 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:01.238669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d7c075d9-9639-42af-a806-f192156f5278 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.190137 Sep 19 11:26:01.243002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 126/246] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:01 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:01.356289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:01.368526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:01.370640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:01.372467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-cb724f7b-0cc6-42de-bb24-54d1d02cbe20 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.243793 Sep 19 11:26:01.373333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 121/247] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:01 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:02.268895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:02.270412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:02.278769 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.279580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.280314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.281243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.282008 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.282647 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.400777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:02.401501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:02.414013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.414660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.415214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.416091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.416794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.417586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.564766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:02.573121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-baff4cc2-3e31-4e34-9a29-445d73f902bc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.310471 Sep 19 11:26:02.573714 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 127/248] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:02 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:02.655837 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:02.669088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:02.671693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:02.676376 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-860146c1-7adc-430a-8b4e-19fbd064128e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.279467 Sep 19 11:26:02.680783 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 122/249] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:02 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:03.598511 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:03.599241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:03.606797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:03.607290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:03.607939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:03.608646 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:03.609134 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:03.609558 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:03.712651 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:03.714052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:03.722003 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:03.722749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:03.723403 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:03.725484 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:03.726234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:03.726809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:03.823844 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:03.826040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:03.833104 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5f4de1d5-b6bd-4a9a-a6b4-cd13a1656caf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.238102 Sep 19 11:26:03.834272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 128/250] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:03 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:03.921806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:03.932055 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:03.932714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:03.933887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a8c4ecd1-7dea-404b-a12e-2c11c8320e30 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.229501 Sep 19 11:26:03.934443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 123/251] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:03 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:04.859307 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:04.859700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:04.867330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:04.868239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:04.868651 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:04.869813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:04.870287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:04.870930 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:04.958936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:04.960391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:04.973478 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:04.974979 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:04.976281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:04.978882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:04.979659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:04.982274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:05.109559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:05.120156 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bab220f4-1f3d-4700-a286-cc4aac19717a tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.265572 Sep 19 11:26:05.132904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 129/252] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:04 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:05.148069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-586299469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-375660481", "security_groups": [{"name": "tempest-secgroup-smoke-2092087392"}], "networks": [{"uuid": "9a951bd2-b6a6-45c5-a4de-273e53cf0967"}], "block_device_mapping_v2": [{"uuid": "cc849521-5b77-47b2-8e24-ef595f380e4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:05.214421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:05.222951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:05.225885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:05.227286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5b22dbd7-4ce2-4973-b280-1499c0b831d4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.272800 Sep 19 11:26:05.228362 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 124/253] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:04 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:05.325393 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] validate_networks() for [('9a951bd2-b6a6-45c5-a4de-273e53cf0967', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:26:05.804075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:26:05.804671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:26:05.805183 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:26:05.806025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:26:05.806492 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:26:05.818447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:05.818447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:05.818447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:05.825312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:05.826238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:05.836588 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:05.871155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Getting quotas for project 221fd300d74c4248a1bfc9b785476477. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:26:05.874637 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:05.877101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Getting quotas for user 6e8793d50fce45f08c0c4000b7ae75e4 and project 221fd300d74c4248a1bfc9b785476477. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:26:05.942029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:26:05.944610 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc849521-5b77-47b2-8e24-ef595f380e4e',volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:26:06.079751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-08a9ffb0-c4a8-47b8-941c-378513243c77 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.936732 Sep 19 11:26:06.086738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 130/254] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:26:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:26:06.093190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-33918d50-e30e-4f76-a2dd-12296dded87d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:06.093956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-33918d50-e30e-4f76-a2dd-12296dded87d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:06.149284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:06.149928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:06.157426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-33918d50-e30e-4f76-a2dd-12296dded87d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:06.158896 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:06.159407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:06.160253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:06.161775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:06.162968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:06.164017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:06.174993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-33918d50-e30e-4f76-a2dd-12296dded87d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1087 microversion: 2.1 time: 0.086807 Sep 19 11:26:06.175950 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 125/255] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:06 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:06.257808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:06.258576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:06.266635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:06.267139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:06.267755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:06.268630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:06.269272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:06.269711 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:06.382254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:06.391105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7bc8a272-77ba-4231-8183-63d2cba7b50f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.246608 Sep 19 11:26:06.391864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 131/256] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:06 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:06.540253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:06.552215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:06.554232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:06.556440 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7a416089-9983-49b2-b29d-b24b81081a4c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1738 microversion: 2.20 time: 0.303089 Sep 19 11:26:06.557912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 126/257] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:06 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:07.201571 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:07.202185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:07.209615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.210106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.210538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.211236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.211691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.212143 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.274541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:07.282440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bb897388-811a-4a2d-94b3-c5d460076131 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1185 microversion: 2.1 time: 0.084650 Sep 19 11:26:07.283012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 132/258] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:07 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:07.418095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:07.418710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:07.425911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.426398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.426836 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.427534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.428522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.428949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.584418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:07.585204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:07.591234 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.591738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.592202 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.592894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.593352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.593953 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.599099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:07.608355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-67b007ba-b964-4728-b37b-0c5bf7794171 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.194754 Sep 19 11:26:07.608926 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 127/259] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:07 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:07.822348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:07.831020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:07.832887 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:07.834823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-417e5f2b-5b99-4291-80b0-2715e3469560 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1720 microversion: 2.20 time: 0.254063 Sep 19 11:26:07.835386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 133/260] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:07 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:08.307412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:08.308152 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:08.315234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.315898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.316424 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.317200 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.318131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.318754 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.390845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:08.399691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3cea4d8d-86f2-4ff3-90bc-3c4ed477d8a5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1185 microversion: 2.1 time: 0.097037 Sep 19 11:26:08.400490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 128/261] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:08 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:08.635321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:08.635948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:08.642789 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.643270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.643699 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.644417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.644869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.645290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.783271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:08.792175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1c51fc41-006d-4e1e-8352-2a54e9efb2c2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.161649 Sep 19 11:26:08.792842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 134/262] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:08 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:08.860476 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:08.861096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:08.868045 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.868546 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.868990 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.869730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.870154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.870586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:09.000663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:09.008921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:09.010388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:09.011561 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d65e3fe1-af56-4d93-b715-7d9968d358fe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1720 microversion: 2.20 time: 0.154992 Sep 19 11:26:09.012151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 129/263] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:08 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:09.423316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:09.424134 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:09.439060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.441047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.441509 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:09.442414 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.442689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.443146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:09.536324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:09.547953 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-115e6841-e336-45b7-93a0-75c69c9b3a9e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1203 microversion: 2.1 time: 0.129172 Sep 19 11:26:09.564568 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 135/264] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:09 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1203 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:09.796207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-0bafd411-992d-4b5d-9500-5d5b8442b3c0 req-3e478962-5f52-48ba-b001-8e28edb0c8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "name": "network-vif-unplugged", "status": "completed", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:09.815942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0bafd411-992d-4b5d-9500-5d5b8442b3c0 req-3e478962-5f52-48ba-b001-8e28edb0c8e8 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.816670 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0bafd411-992d-4b5d-9500-5d5b8442b3c0 req-3e478962-5f52-48ba-b001-8e28edb0c8e8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.816964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:09.817471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0bafd411-992d-4b5d-9500-5d5b8442b3c0 req-3e478962-5f52-48ba-b001-8e28edb0c8e8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:09.818825 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:09.852587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-0bafd411-992d-4b5d-9500-5d5b8442b3c0 req-3e478962-5f52-48ba-b001-8e28edb0c8e8 service nova] Creating event network-vif-unplugged:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:26:09.856295 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.857871 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-0bafd411-992d-4b5d-9500-5d5b8442b3c0 req-3e478962-5f52-48ba-b001-8e28edb0c8e8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066828 Sep 19 11:26:09.858660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 130/265] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:09.865376 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.868481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:09.875569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.876226 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.878253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.040023 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:10.041430 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:10.053380 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.054222 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.054929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.056763 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.057911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.058647 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.249942 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:10.262507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-04b5321d-7649-49ed-9a58-bbbab7f014b1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.449647 Sep 19 11:26:10.263252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 136/266] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:09 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:10.406618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:10.419285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:10.420843 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:10.422052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ca06fdec-8187-42b6-aa22-8fd7f3b20bc5 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1663 microversion: 2.20 time: 0.388153 Sep 19 11:26:10.423031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 131/267] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:10 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1663 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:10.448146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3caa8b7d-90b1-4fc2-88c4-debf89c68e3a"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:10.450795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:10.456783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.457523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.457970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.458662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.459252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.459710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.574072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:10.575028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:10.581323 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.581924 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.582687 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.583588 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.584167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.584731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.762565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-23aa9e1b-c675-4ae7-bc3f-69c6ded56067 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319144 Sep 19 11:26:10.763353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 137/268] 10.222.0.81 () {62 vars in 1364 bytes} [Mon Sep 19 11:26:10 2022] POST /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:26:10.785891 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:10.794255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f01810b0-5aa7-4777-ae05-4c036c0a3edf tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.225711 Sep 19 11:26:10.795074 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 132/269] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:10 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:10.897523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:10.898246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:10.905450 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.905947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.906389 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.907115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:10.907750 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:10.908207 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.951227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120458) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 11:26:11.021360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d3967c73-6c0a-4eca-80a3-1d89be5f34db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/action" status: 202 len: 0 microversion: 2.20 time: 0.128024 Sep 19 11:26:11.022794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 138/270] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 11:26:10 2022] POST /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:26:11.032543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:11.032543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:11.039343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.039940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.040384 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.041088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.041545 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.041971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.058928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-6fffe767-5b0f-4d3f-89c2-fa2bd2c3cab8 req-dbd714e6-fd4c-4d8c-9133-1c267f31696f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:11.075331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-6fffe767-5b0f-4d3f-89c2-fa2bd2c3cab8 req-dbd714e6-fd4c-4d8c-9133-1c267f31696f service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.075890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-6fffe767-5b0f-4d3f-89c2-fa2bd2c3cab8 req-dbd714e6-fd4c-4d8c-9133-1c267f31696f service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.076412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-6fffe767-5b0f-4d3f-89c2-fa2bd2c3cab8 req-dbd714e6-fd4c-4d8c-9133-1c267f31696f service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.092888 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-6fffe767-5b0f-4d3f-89c2-fa2bd2c3cab8 req-dbd714e6-fd4c-4d8c-9133-1c267f31696f service nova] Creating event network-changed:d337a699-9f06-4ec9-8cec-da0fca00d0ab for instance 72e1113c-0919-481f-b283-3f513328bcda on hv-cinder-82099 Sep 19 11:26:11.098970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-6fffe767-5b0f-4d3f-89c2-fa2bd2c3cab8 req-dbd714e6-fd4c-4d8c-9133-1c267f31696f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044116 Sep 19 11:26:11.100026 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 139/271] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:11.292543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:11.293241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:11.303575 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.304391 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.305440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.306510 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.307860 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.308765 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.736950 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:11.739801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:11.747046 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-de9f34a2-d4ce-4358-a1dc-44f23055df6c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1701 microversion: 2.1 time: 0.458855 Sep 19 11:26:11.747755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 140/272] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:11 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1701 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:11.754088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:11.755571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:11.760382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6ef12f9e-b907-4955-88f2-f4d0f6a9c28e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1749 microversion: 2.20 time: 0.733634 Sep 19 11:26:11.761264 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 133/273] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:11 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1749 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:11.771937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-fac998ce-c07d-444f-9542-eaad06740fcc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:11.780326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fac998ce-c07d-444f-9542-eaad06740fcc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.781179 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fac998ce-c07d-444f-9542-eaad06740fcc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.782082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fac998ce-c07d-444f-9542-eaad06740fcc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.819458 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:11.820479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:11.824029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fac998ce-c07d-444f-9542-eaad06740fcc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Going to try to start instance {{(pid=120458) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 11:26:11.828485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.830757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.831317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.832127 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.833035 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.834250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.883478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-fac998ce-c07d-444f-9542-eaad06740fcc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.115896 Sep 19 11:26:11.884383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 141/274] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:26:11 2022] POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:26:11.898488 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:11.900405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:11.910284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.910798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.912185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.913409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.914152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.915023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.921360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:12.173640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:12.183892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d7eea6af-ac4d-463f-9b67-3af8cff367ea tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.370531 Sep 19 11:26:12.185303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 134/275] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:11 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:12.232886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:12.241619 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1a25c0c4-1e1a-40c4-b2c5-72d40442f400 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1710 microversion: 2.1 time: 0.352342 Sep 19 11:26:12.242653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 142/276] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:11 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1710 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:12.789565 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:12.790934 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:12.793764 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=64 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:12.803524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:12.804386 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:12.805052 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:12.805984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:12.806890 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:12.807971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.157356 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:13.170440 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:13.171917 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:13.173105 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-014244c7-ff02-4834-a3bc-59574ae92ec7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1751 microversion: 2.20 time: 0.390126 Sep 19 11:26:13.174260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 135/277] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:12 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1751 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:13.206981 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:13.207871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:13.214329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:13.214810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:13.215244 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.215960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:13.216421 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:13.216847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.266426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:13.267189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:13.273238 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:13.273730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:13.274173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.274868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:13.275329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:13.275925 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.398019 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:13.406322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7da008b3-aff7-4fd5-a9ee-a49e0bb721b0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.203143 Sep 19 11:26:13.407059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 143/278] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:13 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:13.443524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:13.451789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-302e3d1b-9aa1-436b-bba3-a3c48467bb4b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1710 microversion: 2.1 time: 0.189324 Sep 19 11:26:13.452355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 136/279] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:13 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:14.203086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:14.203694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:14.210656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.211211 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.211556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.212275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.212721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.213145 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.349990 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.360667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.363055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.364604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-03fc6421-7a91-4d64-aed3-80f167cc2bd9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.165511 Sep 19 11:26:14.366036 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 144/280] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:14 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:14.430542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:14.431153 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:14.438303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.439044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.439219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.439950 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.440403 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.440819 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.445328 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:14.479127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:14.479801 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:14.486928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.487469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.487937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.488664 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.489190 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.489623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.731813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.740317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-839b3502-bece-4369-8208-431317389f9c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.313653 Sep 19 11:26:14.741239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 137/281] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:14 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:14.767128 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.775796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-665e300b-cdb5-4735-82f0-e8c8ea967c8b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1714 microversion: 2.1 time: 0.302879 Sep 19 11:26:14.776369 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 145/282] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:14 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1714 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:15.391915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:15.392523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:15.399155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:15.399660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:15.400128 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:15.400820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:15.401275 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:15.401704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:15.595028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:15.606092 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:15.607916 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:15.609292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d85c4533-d7ea-4589-858b-b47f526362ec tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.221298 Sep 19 11:26:15.610476 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 138/283] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:15 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:15.763387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:15.764940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:15.773263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:15.774115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:15.775089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:15.776052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:15.776617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:15.777105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:15.848325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:15.890002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:15.984195 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:15.992924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-74e8149a-e3a2-4a23-adac-9f47149cdcdb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.233756 Sep 19 11:26:16.001462 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 146/284] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:15 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:16.645815 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:16.646601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:16.648385 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:16.654041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:16.654920 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:16.655517 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:16.659951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:16.659951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:16.659951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:16.808589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:16.817599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:16.819093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:16.820297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d76974fb-1ea8-4847-ab59-de33b57383ce tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.178830 Sep 19 11:26:16.822154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 139/285] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:16 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:17.020140 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:17.020797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:17.032958 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.033463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.033918 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:17.034621 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.035079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.035512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:17.405926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:17.418271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-85425cbd-a383-45e4-a14d-8d5d22f38d2d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.403186 Sep 19 11:26:17.418967 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 147/286] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:17 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:17.847799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:17.848421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:17.854795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.855283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.855726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:17.856441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.856901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.857336 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:18.010510 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:18.019445 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:18.021271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:18.022659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-94365a5b-dffc-4160-931c-2b8e9f656c0d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.178818 Sep 19 11:26:18.023560 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 140/287] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:17 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:18.443957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:18.445207 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:18.453335 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:18.453931 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:18.454537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:18.455321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:18.455997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:18.456662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:18.635511 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:18.643605 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b55c5a35-c859-4a8f-aebc-566ba32fa875 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.205122 Sep 19 11:26:18.644904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 148/288] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:18 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:19.048897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:19.049541 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:19.056671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.057188 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.057608 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.058312 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.058773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.059203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.200169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:19.210009 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:19.211497 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:19.212709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f4e8a89f-f67a-43ac-a880-e64e1a13145c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.167789 Sep 19 11:26:19.213699 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 141/289] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:19 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:19.673707 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:19.675908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:19.683592 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.685763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.686301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.687131 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.687682 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.688246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.846458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:19.854806 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f6e75d0e-dadb-4d28-ad51-521369146c9d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.191077 Sep 19 11:26:19.855415 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 149/290] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:19 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:20.238396 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:20.239017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:20.245526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.246009 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.246447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.247140 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.247590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.248041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.398586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:20.407731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:20.409529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:20.410896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7ad36c82-402a-4a00-92ce-2309b6602398 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.176428 Sep 19 11:26:20.412179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 142/291] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:20 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:20.878785 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:20.879583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:20.889612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.890115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.890554 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.891260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.891718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.892170 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:21.109832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:21.121612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-dc69dfb7-69d0-433b-9b86-2346293fd483 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.246052 Sep 19 11:26:21.123435 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 150/292] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:20 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:21.438145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:21.438892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:21.446147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:21.446649 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:21.447100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:21.447833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:21.448300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:21.448732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:21.591672 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:21.600791 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:21.602518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:21.608808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-de8e796e-1e40-4c55-a094-d396a6260f7b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.175514 Sep 19 11:26:21.610061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 143/293] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:21 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:22.147094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:22.148568 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:22.155457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:22.156312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:22.157143 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.158072 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:22.158890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:22.160381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.332427 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:22.343674 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-00e688db-a969-4fea-b3f6-83085cde6fe4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.201070 Sep 19 11:26:22.356785 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 151/294] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:22 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:22.634948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:22.635731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:22.642705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:22.643336 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:22.643868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.644913 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:22.645586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:22.646281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.837130 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:22.848420 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:22.850741 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:22.852198 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f5949aac-f91a-4ef8-b09c-d007bb919c3a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.221309 Sep 19 11:26:22.852995 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 144/295] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:22 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:23.370734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:23.371398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:23.377935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.378429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.378870 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:23.379603 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.380633 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.381079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:23.515426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:23.523848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-89ca9405-05ec-4640-93e6-b843596caeef tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.157090 Sep 19 11:26:23.524358 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 152/296] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:23 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:23.878732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:23.879345 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:23.885766 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.886245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.886677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:23.887353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.887833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.888257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:24.055813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:24.065851 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:24.067290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:24.068500 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bfdf77a8-ed67-4696-aa35-55905c1496fd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.193641 Sep 19 11:26:24.069379 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 145/297] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:23 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:24.546233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:24.546844 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:24.553359 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:24.553848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:24.554386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:24.555103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:24.555562 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:24.556169 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:24.738593 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:24.746354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5ef21c7c-8870-4ce7-8360-b20f8dcdcd11 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.204027 Sep 19 11:26:24.746925 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 153/298] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:24 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:25.094616 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:25.095239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:25.103468 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.104129 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.104615 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.105324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.105811 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.106515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.282295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:25.291197 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:25.292697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:25.294103 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1423661d-2273-4957-bb8b-5e72c9ac8daf tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.203388 Sep 19 11:26:25.294662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 146/299] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:25 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:25.770377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:25.771952 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:25.778393 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.778882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.779315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.780035 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.780523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.781224 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.926321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:25.935303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8186336f-676b-4cb1-8b6d-845ceff15783 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.169647 Sep 19 11:26:25.935902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 154/300] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:25 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:26.329420 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:26.330034 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:26.337085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.337576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.338193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.338897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.339355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.340004 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.472094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:26.481877 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:26.483332 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:26.484520 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-20dd6268-b4f5-42ec-b635-d6947d253044 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.158997 Sep 19 11:26:26.485081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 147/301] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:26 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:26.958243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:26.958897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:26.966218 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.966715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.967154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.967920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.968386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.968814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.115259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:27.126508 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5a7fe79c-d94e-4d6e-b2e9-ad6bc1e100ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.172343 Sep 19 11:26:27.127095 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 155/302] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:26 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:27.512212 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:27.512768 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:27.519640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.520146 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.521131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.521810 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.522261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.522680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.650915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:27.660968 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:27.663253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:27.664677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-915d04fa-62b6-48f1-ab15-f42bc613e058 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.156388 Sep 19 11:26:27.665231 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 148/303] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:27 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:27.816178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-58f17189-a553-45f5-84f0-12730094da3d req-671889da-9220-4541-b824-b655eb63d7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "name": "network-vif-plugged", "status": "completed", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:27.826496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-58f17189-a553-45f5-84f0-12730094da3d req-671889da-9220-4541-b824-b655eb63d7aa service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.827060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-58f17189-a553-45f5-84f0-12730094da3d req-671889da-9220-4541-b824-b655eb63d7aa service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.827617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-58f17189-a553-45f5-84f0-12730094da3d req-671889da-9220-4541-b824-b655eb63d7aa service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.839059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-58f17189-a553-45f5-84f0-12730094da3d req-671889da-9220-4541-b824-b655eb63d7aa service nova] Creating event network-vif-plugged:d337a699-9f06-4ec9-8cec-da0fca00d0ab for instance 72e1113c-0919-481f-b283-3f513328bcda on hv-cinder-82099 Sep 19 11:26:27.844024 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-58f17189-a553-45f5-84f0-12730094da3d req-671889da-9220-4541-b824-b655eb63d7aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031546 Sep 19 11:26:27.845179 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 156/304] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:28.149908 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:28.150585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:28.156658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:28.157143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:28.157577 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:28.158635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:28.159095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:28.159520 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:28.285998 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:28.294110 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2cf4d7c4-822a-4512-aaa2-5d7e722b2a52 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.148355 Sep 19 11:26:28.294669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 149/305] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:28 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:28.690381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:28.691079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:28.697789 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:28.698272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:28.698712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:28.699404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:28.699892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:28.700324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:28.829390 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:28.838315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:28.839796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:28.840959 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e504dff6-8836-4211-bb61-fb1bf3e5253f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.155444 Sep 19 11:26:28.841521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 157/306] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:28 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:29.316924 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:29.317584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:29.324046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.324534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.324979 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.325672 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.326134 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.326566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.459558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:29.470162 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f9d38343-df87-4524-8159-12d3778d2be4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.156919 Sep 19 11:26:29.470742 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 150/307] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:29 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:29.866364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:29.866978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:29.873498 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.873987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.874428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.875116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.875569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.876021 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.001634 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.010587 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.012051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.013192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2bb343e1-81f2-40b3-91cd-220832986c34 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.150782 Sep 19 11:26:30.013748 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 158/308] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:29 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:30.494464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:30.495055 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:30.501550 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.502033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.502467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.503149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.503606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.504061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.639585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.647922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f296ab7e-0328-4e2b-a4c4-baa26da00dc1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.157290 Sep 19 11:26:30.648474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 151/309] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:30 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:30.663516 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c50b3b5-09a3-4e2d-9f9f-cc4414f10438"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:30.665909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:30.671810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.672300 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.672729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.673840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.673840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.674251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.687553 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=100 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:31.039007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:31.039620 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:31.045504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:31.045984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:31.046419 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:31.047106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:31.047561 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:31.048022 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:31.175151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:31.184219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:31.185673 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:31.186833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a923e75a-9e12-43b6-8512-b40e9546a73e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.152285 Sep 19 11:26:31.187440 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 152/310] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:31 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:31.674085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:31.674768 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:31.681206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:31.681693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:31.682133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:31.682827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:31.683285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:31.683717 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:31.815063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:31.818503 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:31.823680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f992a2e9-debd-45dc-8f50-e4a39e82fe47 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.156817 Sep 19 11:26:31.824275 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 153/311] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:31 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:32.212017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:32.212564 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:32.218574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.219056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.219490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.220204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.220651 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.221077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.365765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:32.376033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:32.377503 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:32.378669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-94add52c-c5f8-4fbd-b038-041686c14b5f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.170718 Sep 19 11:26:32.379282 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 154/312] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:32 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:32.845943 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:32.846651 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:32.853201 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.853696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.854134 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.854827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.855283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.855744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.034775 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:33.043428 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0b640608-3998-4482-adc9-a360fcdf0726 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1259 microversion: 2.1 time: 0.201257 Sep 19 11:26:33.044027 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 155/313] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:32 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:33.403397 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:33.404100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:33.409987 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.410482 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.410923 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.411610 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.412100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.412531 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.608669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:33.618096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:33.619929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:33.621193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ea0954e8-ed04-406f-95b0-b436847f296a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.221724 Sep 19 11:26:33.621831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 156/314] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:33 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:26:33.634001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-75ee30f3-3df8-40ab-877b-b1690e502351 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.974792 Sep 19 11:26:33.634648 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 159/315] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:26:30 2022] POST /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments => generated 194 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:34.066713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:34.068219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:34.074953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.075446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.075927 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.076709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.077173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.077603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.221208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.229437 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8c488339-9d28-4ebb-98a5-40fba06aa45a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1444 microversion: 2.1 time: 0.166773 Sep 19 11:26:34.229992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 157/316] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:34 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:34.255525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:34.256514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:34.262825 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.263371 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.263861 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.264584 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.265060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.265538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.415795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.423700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-61a96a43-7f86-492a-a351-4e7c4f9d64fd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1444 microversion: 2.1 time: 0.173458 Sep 19 11:26:34.424349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 160/317] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:34 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:34.649423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:34.650282 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:34.668479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.669249 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.674534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.675343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.675978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.677098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.825325 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.835662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.837277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.838519 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-235f2075-5ca0-490b-b706-46c6a920f867 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.193472 Sep 19 11:26:34.839172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 158/318] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:34 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:35.865662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:35.867091 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:35.874569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.875305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.876229 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.877160 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.877838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.878547 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.902981 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-3aad688e-ce24-4685-8a05-390af68f2452 req-a840d258-1e31-48a9-ac92-865910baa9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "name": "network-vif-plugged", "status": "completed", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:35.925501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3aad688e-ce24-4685-8a05-390af68f2452 req-a840d258-1e31-48a9-ac92-865910baa9ee service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.926789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3aad688e-ce24-4685-8a05-390af68f2452 req-a840d258-1e31-48a9-ac92-865910baa9ee service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.927405 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3aad688e-ce24-4685-8a05-390af68f2452 req-a840d258-1e31-48a9-ac92-865910baa9ee service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.943211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-3aad688e-ce24-4685-8a05-390af68f2452 req-a840d258-1e31-48a9-ac92-865910baa9ee service nova] Creating event network-vif-plugged:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:26:35.951423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-3aad688e-ce24-4685-8a05-390af68f2452 req-a840d258-1e31-48a9-ac92-865910baa9ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056986 Sep 19 11:26:35.952678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 159/319] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:26:36.080801 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:36.089669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:36.091118 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:36.092314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7bea718d-a197-4d00-a4c9-f1e139a0c3c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.231728 Sep 19 11:26:36.092872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 161/320] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:35 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:36.332311 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-044f2d9a-21ac-417a-a38a-d57b3af4c1d1 req-7ae9b259-dd73-4763-8cbf-1ffeaa14cf0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:36.344076 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-044f2d9a-21ac-417a-a38a-d57b3af4c1d1 req-7ae9b259-dd73-4763-8cbf-1ffeaa14cf0a service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.345143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-044f2d9a-21ac-417a-a38a-d57b3af4c1d1 req-7ae9b259-dd73-4763-8cbf-1ffeaa14cf0a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.345579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-044f2d9a-21ac-417a-a38a-d57b3af4c1d1 req-7ae9b259-dd73-4763-8cbf-1ffeaa14cf0a service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.358581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-044f2d9a-21ac-417a-a38a-d57b3af4c1d1 req-7ae9b259-dd73-4763-8cbf-1ffeaa14cf0a service nova] Creating event network-changed:d337a699-9f06-4ec9-8cec-da0fca00d0ab for instance 72e1113c-0919-481f-b283-3f513328bcda on hv-cinder-82099 Sep 19 11:26:36.364174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-044f2d9a-21ac-417a-a38a-d57b3af4c1d1 req-7ae9b259-dd73-4763-8cbf-1ffeaa14cf0a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037932 Sep 19 11:26:36.364775 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 160/321] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:37.120053 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:37.120671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:37.123947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:37.130279 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:37.130905 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:37.131449 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:37.132322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:37.132882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:37.133426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:37.292410 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:37.307389 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:37.310297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:37.311871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-787ba827-af4a-47d0-93fc-d63d98179043 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.197445 Sep 19 11:26:37.312684 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 162/322] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:37 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:38.339814 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:38.340691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:38.347393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:38.348526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:38.349175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:38.349883 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:38.350341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:38.351064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:38.523751 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:38.535354 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:38.537365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:38.538688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ef11fb29-5ae6-469c-8909-e46ddfecba8b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1807 microversion: 2.20 time: 0.204238 Sep 19 11:26:38.539349 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 161/323] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:38 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:39.564559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:39.565262 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:39.573321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.573829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.574447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.575179 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.575837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.576277 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.786327 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:39.796213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:39.797705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:39.799103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-89d3d35e-659d-4f98-bb31-26be1ba739a9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1794 microversion: 2.20 time: 0.238922 Sep 19 11:26:39.799669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 163/324] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:26:39 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1794 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:26:41.298298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:41.301184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:41.307669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:41.308203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:41.308630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.309496 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:41.310299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:41.310887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.335755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lazy-loading 'flavor' on Instance uuid e6be205d-fa54-491f-87bf-159cda85b1c3 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:26:41.522184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d58074b9-d2a5-4156-89b6-bdf69463f6bb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/action" status: 200 len: 32 microversion: 2.1 time: 0.227708 Sep 19 11:26:41.523041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 162/325] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:26:41 2022] POST /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:26:41.533563 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:41.534282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:41.543556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:41.544163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:41.544840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.546016 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:41.546822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:41.547566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.851416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:41.862425 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3d27ec01-da56-48a2-abf7-4d6ce5ad8623 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.333743 Sep 19 11:26:41.863612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 164/326] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:41 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:42.886595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:42.887866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:42.894164 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=56 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:42.896153 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:42.896650 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:42.897293 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:42.898166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:42.898970 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:42.899570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:43.078178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:43.093439 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-db7c56ee-ed38-4d19-8f13-c0667dec487a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.211520 Sep 19 11:26:43.094296 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 163/327] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:42 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:44.117432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:44.118769 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:44.126201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:44.126867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:44.127499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:44.128411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:44.129092 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:44.129864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:44.314577 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:44.326555 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-65ecb3d3-dacb-486a-bc2e-5ffe476bf1b4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.213480 Sep 19 11:26:44.327851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 165/328] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:44 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:45.351732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:45.353862 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:45.384341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:45.385739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:45.386686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:45.387597 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:45.388319 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:45.388921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:45.807228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:45.818296 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-53a7c99a-83dc-4143-9a69-78ec38183fa7 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.471093 Sep 19 11:26:45.819585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 164/329] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:45 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:46.815641 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-47009325-910f-4715-92e2-6b5a18f70f32 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Action: 'create', calling method: .version_select at 0x7ff521795280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-847173717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXVLKtkL1VQ40gV/HFMae9NooZzbaDFKLjFE+cKas3fPV9dArf5+S8Dt6E07Ufg/B4XZZsIAcQ5J1A0jItprcOEL4gR5qO2VEi5a6UV2eObDHz9l1QJYsC4eMQL3ZALbQ=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:46.831242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-47009325-910f-4715-92e2-6b5a18f70f32 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:26:46.836213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-47009325-910f-4715-92e2-6b5a18f70f32 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for user 7f546dc2d8b24eeea8c6eac968c56806 and project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:26:46.842948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:46.843499 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:46.850281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.850776 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.851232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.851940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.852400 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.852827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.860869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-47009325-910f-4715-92e2-6b5a18f70f32 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.216376 Sep 19 11:26:46.861815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 166/330] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:26:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:47.022339 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:47.030754 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8660eb4e-681a-49d8-8e14-5b8cf96692c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.191686 Sep 19 11:26:47.031320 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 165/331] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:46 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:48.054569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:48.055628 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:48.063398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:48.068878 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:48.069458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:48.070432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:48.071414 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:48.071988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:48.241366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:48.251094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-abd537d6-792d-41ab-9d42-86a9a8c4c888 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.200462 Sep 19 11:26:48.251859 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 167/332] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:48 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:49.276271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:49.276919 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:49.283430 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:49.283982 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:49.284451 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:49.285153 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:49.285616 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:49.286054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:49.430853 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:49.439239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-59efa1d3-6352-4573-b026-0c89b7b88ead tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.166796 Sep 19 11:26:49.440215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 166/333] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:49 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:50.465058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:50.465669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:50.472446 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:50.472935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:50.473364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:50.474058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:50.474513 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:50.474936 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:50.633893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:50.642447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1e69a86b-d919-41da-bd7d-3e660ee19227 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.181379 Sep 19 11:26:50.649226 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 168/334] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:50 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:51.677747 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:51.678628 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:51.692713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:51.693224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:51.693682 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:51.694395 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:51.694854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:51.695278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:51.837780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:51.846080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-18a3fddd-d6b4-4f24-942e-9f5628fd0d08 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.173056 Sep 19 11:26:51.846728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 167/335] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:51 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:52.871184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:52.871830 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:52.879103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:52.879597 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:52.880068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:52.880767 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:52.881303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:52.881732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:53.016074 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:53.024286 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e3be899b-2291-4faa-9938-fd3dd481643a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.157726 Sep 19 11:26:53.024856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 169/336] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:52 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:54.048170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:54.048773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:54.055900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:54.056403 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:54.056845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:54.057552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:54.058029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:54.058440 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:54.197265 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:54.205473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-842ced63-2a1b-4715-a78e-e9b9f194e035 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.161714 Sep 19 11:26:54.206043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 168/337] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:54 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:55.229692 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:55.230489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:55.236819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:55.237306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:55.238269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:55.239025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:55.239481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:55.239941 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:55.372034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:55.381829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2db8470e-df27-4382-92e9-25c1191bc8d6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.156042 Sep 19 11:26:55.382403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 170/338] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:55 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:56.404491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:56.405108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:56.412123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.412606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.413047 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.413740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.414196 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.414622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.549333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:56.553300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:56.558828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-70c04fe8-4818-4994-a6e5-b5c6c4afa065 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.158172 Sep 19 11:26:56.559393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 169/339] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:56 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:56.701564 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:56.702093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:56.709827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.710309 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.710741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.711433 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.711910 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.712330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.839431 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lazy-loading 'services' on Instance uuid fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:26:56.876726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=4 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:56.960794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9d3441b0-a62f-4335-b7d1-e833d3df92ce tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-volume_attachments/4d088c8b-b9e2-467e-b7cf-5c7904ad0bf5" status: 202 len: 0 microversion: 2.1 time: 0.263136 Sep 19 11:26:56.961639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 171/340] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:26:56 2022] DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-volume_attachments/4d088c8b-b9e2-467e-b7cf-5c7904ad0bf5 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:26:57.581641 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:57.582271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:57.589839 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.590332 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.590811 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.591506 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.591992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.592423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.732031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:57.740966 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9466e7e0-c9ac-4f42-ab0a-416b062dcfdb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.163331 Sep 19 11:26:57.741469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 170/341] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:57 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:58.085935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-82d6ed42-487b-4277-8a2c-f334f88c0249 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:58.092198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-82d6ed42-487b-4277-8a2c-f334f88c0249 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.092683 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-82d6ed42-487b-4277-8a2c-f334f88c0249 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.093122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-82d6ed42-487b-4277-8a2c-f334f88c0249 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.114550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-82d6ed42-487b-4277-8a2c-f334f88c0249 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Going to try to stop instance {{(pid=120458) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 11:26:58.156195 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-82d6ed42-487b-4277-8a2c-f334f88c0249 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.075587 Sep 19 11:26:58.156795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 172/342] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:26:58 2022] POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:26:58.164960 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:58.165624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:58.171609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.172133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.172588 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.173272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.173731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.174163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.304448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:58.313157 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2180dd41-a9df-4d7e-af28-077c3d38e289 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1724 microversion: 2.1 time: 0.152041 Sep 19 11:26:58.313924 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 171/343] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:58 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:58.764898 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:58.765590 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:58.772495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.772988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.773425 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.774171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.774668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.775010 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.908470 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:58.918388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2a19538f-ba0b-4d9d-84af-73617a4b8607 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.157674 Sep 19 11:26:58.918987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 173/344] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:58 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:59.336513 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:59.337121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:59.343488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.344007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.344439 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.345116 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.345566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.345988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.480278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:59.488204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4a10160e-4373-413b-ac5c-0281a713049e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.155996 Sep 19 11:26:59.488774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 172/345] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:59 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:59.941215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:59.941805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:59.948201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.948680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.949118 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.949793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.950236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.950654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.953269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:00.084290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:00.092360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6426bebd-cda1-48f5-a986-e0cbfda137c1 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.155087 Sep 19 11:27:00.092918 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 174/346] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:59 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:00.511724 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:00.512317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:00.514613 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:27:00.514760 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Mon Sep 19 11:27:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 (ip 10.222.0.81) !!! Sep 19 11:27:00.528523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:00.529020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:00.529470 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:00.530173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:00.530635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:00.531068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:00.661415 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:00.669150 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8b17ef03-2d49-4fab-8e99-7e65f0d1eff8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.161399 Sep 19 11:27:00.669728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 173/347] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:00 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:01.114429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:01.115111 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:01.121708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:01.122196 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:01.122638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:01.123329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:01.123802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:01.124233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:01.260731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:01.268948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-32ff6209-7eda-40b4-81e1-1e969f872dae tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1732 microversion: 2.1 time: 0.158424 Sep 19 11:27:01.269514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 175/348] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:01 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:01.692203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:01.692852 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:01.699229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:01.699720 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:01.700204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:01.700904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:01.701370 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:01.701802 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:01.831072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:01.838978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5e273134-222f-4446-8ccc-7e5498ca681b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.150646 Sep 19 11:27:01.839541 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 174/349] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:01 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:02.291840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:02.292454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.298930 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.299416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.299886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.300576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.301030 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.301462 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.426350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:02.434489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-96840d68-8428-4452-88b9-250c1c0d42e4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1712 microversion: 2.1 time: 0.146562 Sep 19 11:27:02.435063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 176/350] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:02 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1712 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:02.543151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:02.543654 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.549618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.553683 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.554144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.556955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.556955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.557430 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.678464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] HTTP exception thrown: Cannot 'detach_volume' instance e6be205d-fa54-491f-87bf-159cda85b1c3 while it is in vm_state rescued Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Request method failure captured: Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments/4c50b3b5-09a3-4e2d-9f9f-cc4414f10438 HTTP/1.1 Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE719UvpezPNvQaaanqD4PcCWo6l7Ntm0rvI7ztghwwneiFW7ghElnLw9QbHp-IlsoDFFdAPcvtvYgjLrXmu5JnecRrD4N6situzQJt9sGXI3kLio4zbKRcoF9TxyIas68Ga33TugbFY3Kwz6QLzMiSSTLbBn4Mqh-aautQRHBERFo Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:27:02.680093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c7ccdce201f547f5a50c93e27c5e8cb1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}] Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 9f160368e1984319ad4fa37c2794a956 Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:27:02.681598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Cannot 'detach_volume' instance e6be205d-fa54-491f-87bf-159cda85b1c3 while it is in vm_state rescued Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'server_id': 'e6be205d-fa54-491f-87bf-159cda85b1c3', 'id': '4c50b3b5-09a3-4e2d-9f9f-cc4414f10438'} Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:27:02.682542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e6be205d-fa54-491f-87bf-159cda85b1c3 while it is in vm_state rescued Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e6be205d-fa54-491f-87bf-159cda85b1c3 while it is in vm_state rescued Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:27:02.683730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Returning 409 to user: Cannot 'detach_volume' instance e6be205d-fa54-491f-87bf-159cda85b1c3 while it is in vm_state rescued {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:27:02.684712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2de345ff-7662-4464-8108-f183344d86af tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments/4c50b3b5-09a3-4e2d-9f9f-cc4414f10438" status: 409 len: 152 microversion: 2.1 time: 0.142323 Sep 19 11:27:02.684712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 175/351] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:27:02 2022] DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments/4c50b3b5-09a3-4e2d-9f9f-cc4414f10438 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:27:02.690337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:02.691443 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.697231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.697710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.698138 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.698809 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.699253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.699665 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.762884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cf6dea9f-ad83-45af-a4d4-6ecdc375bb99 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "POST /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/action" status: 202 len: 0 microversion: 2.1 time: 0.076058 Sep 19 11:27:02.766453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 177/352] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:27:02 2022] POST /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:02.774961 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:02.775581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.781732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.782415 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.782858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.783561 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.784046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.784498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.863638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:02.864377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.870488 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.870977 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.871416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.872128 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.872586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.873011 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:03.057626 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:03.066326 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-79be2ee1-23d3-41ea-8835-045d611e8488 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1720 microversion: 2.1 time: 0.298125 Sep 19 11:27:03.066983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 176/353] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:02 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1720 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:03.145498 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:03.153407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-251a43a6-43b0-4a5c-84de-4a72c2dc2716 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.294680 Sep 19 11:27:03.153979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 178/354] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:02 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:04.090343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:04.090921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:04.097787 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.098270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.098710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.099431 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.099949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.100382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.177092 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:04.178478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:04.187456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.188086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.188625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.189395 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.190068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.191254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.245294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:04.254056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-240768d1-c89d-4a1a-b080-121af466d339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1720 microversion: 2.1 time: 0.167135 Sep 19 11:27:04.254622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 177/355] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:04 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:04.327140 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:04.335485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7e6df604-a32c-442e-8ae3-d6b7cbec7563 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.162760 Sep 19 11:27:04.336100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 179/356] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:04 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:05.276607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:05.277351 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:05.283801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:05.284848 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:05.285290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:05.285983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:05.286442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:05.286872 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:05.358524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:05.359147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:05.366038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:05.366530 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:05.366972 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:05.367665 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:05.368154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:05.368584 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:05.430585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:05.439250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-46ce2ec6-4879-493c-874b-e2f2f2b0f87d tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1720 microversion: 2.1 time: 0.166492 Sep 19 11:27:05.439840 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 178/357] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:05 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:05.519597 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:05.529625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-33e458a8-4f56-4f1d-9b6c-773c8cb7028b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.174825 Sep 19 11:27:05.530057 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 180/358] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:05 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:05.552068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-816055811", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-847173717", "security_groups": [{"name": "tempest-secgroup-smoke-1916601463"}], "block_device_mapping_v2": [{"uuid": "c1c20e77-8151-4ccf-9403-9ac1c4024033", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fb35c99b-23b9-4b32-a307-2150c63e0c0a"}]}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:05.664029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] validate_networks() for [('fb35c99b-23b9-4b32-a307-2150c63e0c0a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:27:06.252281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:27:06.252714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:27:06.253826 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:27:06.254257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:27:06.254687 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:27:06.263498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.264031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.264479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.265215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.265681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.266117 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.283393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:06.287931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for user 7f546dc2d8b24eeea8c6eac968c56806 and project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:06.343245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:27:06.345385 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1c20e77-8151-4ccf-9403-9ac1c4024033',volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:27:06.462868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:06.463481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:06.469986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.470229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4f6fd264-1169-41a0-b091-100806d83a40 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.922649 Sep 19 11:27:06.470480 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.477692 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.477874 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 179/359] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:27:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:27:06.477970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.477970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.477970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.483654 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4d649f8c-1671-4149-bf0f-fc342fcc289c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:06.484364 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4d649f8c-1671-4149-bf0f-fc342fcc289c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:06.573970 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4d649f8c-1671-4149-bf0f-fc342fcc289c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:06.581915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4d649f8c-1671-4149-bf0f-fc342fcc289c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1093 microversion: 2.1 time: 0.101858 Sep 19 11:27:06.582605 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 180/360] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:06 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1093 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:06.587343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:06.588104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:06.595349 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.596333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.597790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.598833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.599488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.600183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.692983 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:06.701581 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bc1ad139-13dc-4016-bd2c-fcc235cbcc09 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1726 microversion: 2.1 time: 0.242376 Sep 19 11:27:06.702028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 181/361] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:06 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1726 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:06.724138 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:06.724943 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:06.731061 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.731556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.732028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.732932 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.733389 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.733819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.764689 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:06.773327 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-51eade5a-31ad-45fd-aa8a-08e0f825c8c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.189458 Sep 19 11:27:06.773909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 181/362] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:06 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:06.819929 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-49d64c12-47d6-4d66-a9f2-5e501b8941be tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099873 Sep 19 11:27:06.820763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 182/363] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:27:06 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:07.605364 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:07.606105 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:07.613816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.614398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.614912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:07.615722 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.616358 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.616854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:07.687338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:07.695691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bb2bf36f-bbb3-45e7-b8c7-cc094957f8df tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1191 microversion: 2.1 time: 0.094144 Sep 19 11:27:07.696318 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 182/364] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:07 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:07.714645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-986b67ff-ea6e-4866-a2f9-e0db78315f40 req-6c4ab6f7-3cf0-423f-8aed-0e660811d1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be205d-fa54-491f-87bf-159cda85b1c3", "tag": "7caf44f4-6ec4-453f-b026-5ce545b8b513"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:07.726411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:07.729669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-986b67ff-ea6e-4866-a2f9-e0db78315f40 req-6c4ab6f7-3cf0-423f-8aed-0e660811d1e4 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.730983 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-986b67ff-ea6e-4866-a2f9-e0db78315f40 req-6c4ab6f7-3cf0-423f-8aed-0e660811d1e4 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.731633 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-986b67ff-ea6e-4866-a2f9-e0db78315f40 req-6c4ab6f7-3cf0-423f-8aed-0e660811d1e4 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:07.747072 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-986b67ff-ea6e-4866-a2f9-e0db78315f40 req-6c4ab6f7-3cf0-423f-8aed-0e660811d1e4 service nova] Creating event network-changed:7caf44f4-6ec4-453f-b026-5ce545b8b513 for instance e6be205d-fa54-491f-87bf-159cda85b1c3 on hv-cinder-82099 Sep 19 11:27:07.752466 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-986b67ff-ea6e-4866-a2f9-e0db78315f40 req-6c4ab6f7-3cf0-423f-8aed-0e660811d1e4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042586 Sep 19 11:27:07.753705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 183/365] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:07.798543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:07.799165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:07.812148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.814692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.816994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:07.817904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.818576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.819238 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:08.173926 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:08.183098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-75b91964-a495-4b4a-8fa6-dbccef298304 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.388237 Sep 19 11:27:08.183949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 183/366] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:07 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:08.720917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:08.722155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:08.728670 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:08.729155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:08.729590 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:08.730281 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:08.730733 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:08.731158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:08.804762 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:08.812615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e2e4f14b-70de-42df-97ea-bdd6b063a7bf tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1197 microversion: 2.1 time: 0.095937 Sep 19 11:27:08.813201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 184/367] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:08 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:09.207483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:09.208412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:09.214504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.215017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.215444 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:09.216170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.216636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.217069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:09.481791 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:09.490049 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-661b2d9c-3629-40d7-a03d-17643e0c8b48 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1678 microversion: 2.1 time: 0.286872 Sep 19 11:27:09.490813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 184/368] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:09 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:09.769224 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-d1bd9a20-f938-48bf-8feb-8f049ffd0974 req-a0c1bc9b-cb5e-41a0-967a-38f397181621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6be205d-fa54-491f-87bf-159cda85b1c3", "tag": "7caf44f4-6ec4-453f-b026-5ce545b8b513"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:09.779517 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-d1bd9a20-f938-48bf-8feb-8f049ffd0974 req-a0c1bc9b-cb5e-41a0-967a-38f397181621 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.780024 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-d1bd9a20-f938-48bf-8feb-8f049ffd0974 req-a0c1bc9b-cb5e-41a0-967a-38f397181621 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.780632 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-d1bd9a20-f938-48bf-8feb-8f049ffd0974 req-a0c1bc9b-cb5e-41a0-967a-38f397181621 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:09.791734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-d1bd9a20-f938-48bf-8feb-8f049ffd0974 req-a0c1bc9b-cb5e-41a0-967a-38f397181621 service nova] Creating event network-changed:7caf44f4-6ec4-453f-b026-5ce545b8b513 for instance e6be205d-fa54-491f-87bf-159cda85b1c3 on hv-cinder-82099 Sep 19 11:27:09.796854 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-d1bd9a20-f938-48bf-8feb-8f049ffd0974 req-a0c1bc9b-cb5e-41a0-967a-38f397181621 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031266 Sep 19 11:27:09.797444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 185/369] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:09.835792 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:09.836406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:09.842332 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.842817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.843250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:09.843968 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.844456 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.844882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.048801 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-e3d5ab69-6f13-4bf2-a5d1-d68498093461 req-7054997b-b892-43d3-abef-cc5f77c2dae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae508c34-2fb3-4348-b3a0-df59607692b5", "tag": "b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:10.059209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-e3d5ab69-6f13-4bf2-a5d1-d68498093461 req-7054997b-b892-43d3-abef-cc5f77c2dae4 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.059691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-e3d5ab69-6f13-4bf2-a5d1-d68498093461 req-7054997b-b892-43d3-abef-cc5f77c2dae4 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.060189 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-e3d5ab69-6f13-4bf2-a5d1-d68498093461 req-7054997b-b892-43d3-abef-cc5f77c2dae4 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.071221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-e3d5ab69-6f13-4bf2-a5d1-d68498093461 req-7054997b-b892-43d3-abef-cc5f77c2dae4 service nova] Creating event network-changed:b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5 for instance ae508c34-2fb3-4348-b3a0-df59607692b5 on hv-cinder-82099 Sep 19 11:27:10.075913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-e3d5ab69-6f13-4bf2-a5d1-d68498093461 req-7054997b-b892-43d3-abef-cc5f77c2dae4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031335 Sep 19 11:27:10.076523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 186/370] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:27:10.171828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:10.182984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-871cb35f-3bec-49c4-a337-bf004af6a30c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.350762 Sep 19 11:27:10.199237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 185/371] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:09 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:10.514736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:10.515350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:10.522176 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.522666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.523106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.523838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.524296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.524721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.809740 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:10.818184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cbe212a2-4f1c-4a91-9217-ba18a8138617 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1655 microversion: 2.1 time: 0.307776 Sep 19 11:27:10.818768 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 187/372] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:10 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1655 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:10.841187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-950254ca-bea1-41d3-a43b-e80c8ff69d92 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:10.847819 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-950254ca-bea1-41d3-a43b-e80c8ff69d92 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.848391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-950254ca-bea1-41d3-a43b-e80c8ff69d92 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.848839 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-950254ca-bea1-41d3-a43b-e80c8ff69d92 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.909910 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-950254ca-bea1-41d3-a43b-e80c8ff69d92 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Going to try to start instance {{(pid=120459) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 11:27:10.951494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-950254ca-bea1-41d3-a43b-e80c8ff69d92 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.114021 Sep 19 11:27:10.952114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 186/373] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:27:10 2022] POST /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:10.961126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:10.961909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:10.968510 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.969287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.969885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.971176 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.971675 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.972158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:11.207447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:11.208229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:11.212736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:11.214316 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:11.214817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:11.215254 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:11.215980 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:11.216441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:11.216887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:11.220416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-88905306-858d-4033-85a5-0200e71fd2d7 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1664 microversion: 2.1 time: 0.263324 Sep 19 11:27:11.220979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 188/374] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:10 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1664 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:11.229575 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:11.349532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:11.357826 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-33041abf-3b98-40b3-9f49-c736213059ae tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.154952 Sep 19 11:27:11.358412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 187/375] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:11 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:12.243561 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:12.244121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:12.250486 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:12.250973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:12.251413 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:12.252261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:12.253261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:12.253693 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:12.381282 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:12.381904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:12.385412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:12.388498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:12.388991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:12.389433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:12.390136 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:12.390599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:12.391027 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:12.393152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ec6626f9-e938-4739-a817-dc55b821d75c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1664 microversion: 2.1 time: 0.153494 Sep 19 11:27:12.394310 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 189/376] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:12 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:12.521699 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:12.529313 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d1ee1f5c-f2d1-402b-90bb-eb600f1f7147 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.152504 Sep 19 11:27:12.530055 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 188/377] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:12 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:13.416746 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:13.417360 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:13.423778 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:13.424269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:13.425209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:13.425891 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:13.426343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:13.426969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:13.551870 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:13.552488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:13.554838 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:13.555991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:13.560072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:13.560572 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:13.561015 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:13.561713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:13.562178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:13.562607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:13.564608 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e14cd419-3c72-443b-9b03-a469462c9f33 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1668 microversion: 2.1 time: 0.151867 Sep 19 11:27:13.565291 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 190/378] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:13 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:13.691046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:13.698786 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-154fa15f-4b23-4a83-ad0c-6ac40f71b335 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.151389 Sep 19 11:27:13.699347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 189/379] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:13 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:14.722237 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:14.722850 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:14.729888 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.730372 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.730808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.731506 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.732022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.732450 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.860822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:14.868667 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2b13322e-43c4-479c-b68b-a7ce080f3d31 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.150360 Sep 19 11:27:14.869236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 191/380] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:14 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:15.891271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:15.891925 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:15.898406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:15.898976 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:15.899421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:15.900143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:15.900614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:15.901048 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:16.032136 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:16.040374 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d0e06821-e904-4fc2-8b37-e470636f3844 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.153005 Sep 19 11:27:16.040948 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 190/381] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:15 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:17.063656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:17.064296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:17.070838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.071327 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.071787 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.072481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.072939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.073368 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.076017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:17.206540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:17.214194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-04dd03cc-5f25-4e6c-90db-a5f58faab70f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.154400 Sep 19 11:27:17.214749 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 192/382] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:17 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:18.237556 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:18.238087 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:18.239915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:18.240602 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=8 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:18.246918 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:18.247435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:18.247903 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:18.248596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:18.249054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:18.249482 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:18.382099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:18.391136 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9f4c577b-3a5f-414d-9566-36d0cf2bba0d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.158079 Sep 19 11:27:18.391723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 191/383] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:18 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:19.414754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:19.415363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:19.423017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.423515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.424489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:19.425191 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.425641 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.426064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:19.559289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:19.566972 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7173a099-a7e1-4e60-b34a-ae92c82471d1 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.156167 Sep 19 11:27:19.567736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 193/384] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:19 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:20.073528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-bc18ea07-05fa-4141-958e-ae5bb0dd87b3 req-981947a8-f0be-4f76-a4e9-ac6797790fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae508c34-2fb3-4348-b3a0-df59607692b5", "name": "network-vif-plugged", "status": "completed", "tag": "b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:20.085621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-bc18ea07-05fa-4141-958e-ae5bb0dd87b3 req-981947a8-f0be-4f76-a4e9-ac6797790fcc service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.086103 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-bc18ea07-05fa-4141-958e-ae5bb0dd87b3 req-981947a8-f0be-4f76-a4e9-ac6797790fcc service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.086537 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-bc18ea07-05fa-4141-958e-ae5bb0dd87b3 req-981947a8-f0be-4f76-a4e9-ac6797790fcc service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.098590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-bc18ea07-05fa-4141-958e-ae5bb0dd87b3 req-981947a8-f0be-4f76-a4e9-ac6797790fcc service nova] Creating event network-vif-plugged:b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5 for instance ae508c34-2fb3-4348-b3a0-df59607692b5 on hv-cinder-82099 Sep 19 11:27:20.104037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-bc18ea07-05fa-4141-958e-ae5bb0dd87b3 req-981947a8-f0be-4f76-a4e9-ac6797790fcc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Sep 19 11:27:20.104647 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 192/385] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:20.590117 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:20.590730 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:20.597367 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.597853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.598300 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.598981 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.599438 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.599889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.728500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:20.736073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-45b424f4-774a-4144-badc-94f5fccf9345 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.149957 Sep 19 11:27:20.736639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 194/386] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:20 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:21.621882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:21.622466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:21.629286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.629773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.630208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.630884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.631334 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.631755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.659938 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e79813ad-9e4e-41e8-a232-802693ad6f2d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments/3caa8b7d-90b1-4fc2-88c4-debf89c68e3a" status: 200 len: 194 microversion: 2.20 time: 0.042849 Sep 19 11:27:21.660517 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 193/387] 10.222.0.81 () {60 vars in 1454 bytes} [Mon Sep 19 11:27:21 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments/3caa8b7d-90b1-4fc2-88c4-debf89c68e3a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:27:21.729228 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:21.729741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:21.736145 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.737146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.737586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.738269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.738723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.739149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.759578 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:21.760234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:21.765951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.766436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.766874 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.767568 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.768056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.768483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.825308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lazy-loading 'services' on Instance uuid 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:27:21.900349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-de46a542-b3ae-4d57-8227-41b67ef86025 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments/3caa8b7d-90b1-4fc2-88c4-debf89c68e3a" status: 202 len: 0 microversion: 2.20 time: 0.174913 Sep 19 11:27:21.903729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:21.904282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 195/388] 10.222.0.81 () {60 vars in 1457 bytes} [Mon Sep 19 11:27:21 2022] DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments/3caa8b7d-90b1-4fc2-88c4-debf89c68e3a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:27:21.910130 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:21.912263 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c5d500b1-ea63-48e0-bf10-d89accbab2fa tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1265 microversion: 2.1 time: 0.157180 Sep 19 11:27:21.912436 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:21.912820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 194/389] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:21 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:21.918717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.919250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.919702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.920419 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.920867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.921470 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.950494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4427bdaa-cf4d-4234-92df-585492d4b937 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045037 Sep 19 11:27:21.951035 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 196/390] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 11:27:21 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:27:22.935099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:22.935675 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:22.942117 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.942614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.943028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.943709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.944188 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.944608 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.963616 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:22.965808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:22.973241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.973732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.974165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.974857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.975314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.975739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.006974 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a2b88c8f-3115-4356-a09e-8401d45918ac tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048095 Sep 19 11:27:23.007597 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 197/391] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 11:27:22 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:27:23.084964 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:23.092646 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-16fc5af4-4832-4e4c-a336-df3829e72907 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1452 microversion: 2.1 time: 0.161390 Sep 19 11:27:23.093225 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 195/392] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:22 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:23.116721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:23.117358 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:23.123203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.123687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.124157 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.124842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.125299 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.125724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.254687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:23.262332 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-805faa6d-68c7-492b-8a67-6ded83463f5f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1452 microversion: 2.1 time: 0.149502 Sep 19 11:27:23.262894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 198/393] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:23 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:24.019260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:24.021515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:24.027956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.028441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.028885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.029584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.030041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.030471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.059822 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-46135536-3920-45cc-a656-b2ae200ec000 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045108 Sep 19 11:27:24.060391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 196/394] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 11:27:24 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:24.124800 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:24.125351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:24.132505 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.132997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.133442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.134141 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.134599 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.135027 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.160735 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:27:24.244744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-973bdf20-7154-4d31-8611-cac737a3f4db tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 204 len: 0 microversion: 2.20 time: 0.123576 Sep 19 11:27:24.248661 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 199/395] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 11:27:24 2022] DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 11:27:24.256501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:24.257094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:24.263683 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.264197 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.264807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.265690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.266149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.266579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.690040 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:24.698074 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:24.699525 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:24.700709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d3ba11b4-d96f-42cf-b11b-54406aaff15d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.450099 Sep 19 11:27:24.701536 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 197/396] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:24 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:25.225862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-c06ca271-1b51-49ac-900b-36a4d336efa3 req-e914f5d3-b15b-48aa-8693-274a340f3d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae508c34-2fb3-4348-b3a0-df59607692b5", "tag": "b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:25.235365 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c06ca271-1b51-49ac-900b-36a4d336efa3 req-e914f5d3-b15b-48aa-8693-274a340f3d57 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.235874 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c06ca271-1b51-49ac-900b-36a4d336efa3 req-e914f5d3-b15b-48aa-8693-274a340f3d57 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.236960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c06ca271-1b51-49ac-900b-36a4d336efa3 req-e914f5d3-b15b-48aa-8693-274a340f3d57 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.247705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-c06ca271-1b51-49ac-900b-36a4d336efa3 req-e914f5d3-b15b-48aa-8693-274a340f3d57 service nova] Creating event network-changed:b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5 for instance ae508c34-2fb3-4348-b3a0-df59607692b5 on hv-cinder-82099 Sep 19 11:27:25.253220 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-c06ca271-1b51-49ac-900b-36a4d336efa3 req-e914f5d3-b15b-48aa-8693-274a340f3d57 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031389 Sep 19 11:27:25.253810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 200/397] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:25.727151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:25.727799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:25.734648 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.735496 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.736902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.738135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.738997 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.739652 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.906904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.915890 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.917357 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.918525 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3d9553a0-0f09-42ab-9ae9-77a1d7f66aca tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1722 microversion: 2.20 time: 0.195480 Sep 19 11:27:25.919086 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 198/398] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:25 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:26.944660 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:26.945377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:26.951991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:26.952481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:26.952917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:26.953634 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:26.954084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:26.954506 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:27.042985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.057302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.058944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.060125 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-45808374-ff3d-41fd-bd40-a8dafc2d213b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 200 len: 1654 microversion: 2.20 time: 0.119989 Sep 19 11:27:27.060892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 201/399] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:26 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 1654 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:27.316414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-0a3cc8ce-2b61-4874-9c69-16cf9d725da9 req-99b7ccb0-4e5c-4806-9e0d-c1d351e81676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e26364-ddd0-4b3f-aa74-33e3cc7c34ba", "name": "network-vif-deleted", "tag": "58387b5a-4483-4fb4-be22-3a74c3abc32c"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:27.327708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0a3cc8ce-2b61-4874-9c69-16cf9d725da9 req-99b7ccb0-4e5c-4806-9e0d-c1d351e81676 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:27.328474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0a3cc8ce-2b61-4874-9c69-16cf9d725da9 req-99b7ccb0-4e5c-4806-9e0d-c1d351e81676 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:27.329237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0a3cc8ce-2b61-4874-9c69-16cf9d725da9 req-99b7ccb0-4e5c-4806-9e0d-c1d351e81676 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:27.341812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-0a3cc8ce-2b61-4874-9c69-16cf9d725da9 req-99b7ccb0-4e5c-4806-9e0d-c1d351e81676 service nova] Creating event network-vif-deleted:58387b5a-4483-4fb4-be22-3a74c3abc32c for instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba on hv-cinder-82099 Sep 19 11:27:27.347618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-0a3cc8ce-2b61-4874-9c69-16cf9d725da9 req-99b7ccb0-4e5c-4806-9e0d-c1d351e81676 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035077 Sep 19 11:27:27.348992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 199/400] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:28.086438 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:28.087135 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:28.094227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:28.094717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:28.095149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:28.095873 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:28.096328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:28.096751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:28.111458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] HTTP exception thrown: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Request method failure captured: Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba HTTP/1.1 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE_CEkT86VgI6ztA9L1flhznDDkwWoD-mp6U-wwG-_d2dY901H4OsXMQycupmrf8uKuoQVzYr8ooUqwsHQTngZJgbW_Z4VK-jSRgT515suqi3m9x8XzpflXlDMdjqLJu01RqnJUYUQr_4Ccke9IutEZ7X-Q72FhlEtaXJcJ8doSwVA Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:27:28.113287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_078bf59c33cc43579aeb270262079a37", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/078bf59c33cc43579aeb270262079a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}] Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: a3097d9c130746ca840bf85f33bc006b Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:27:28.114696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '37e26364-ddd0-4b3f-aa74-33e3cc7c34ba'} Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:27:28.115474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:27:28.117076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:28.118724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Returning 404 to user: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:27:28.118724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-86f3ea1b-3af5-4e1f-bd5c-ed1874556bd8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 404 len: 111 microversion: 2.20 time: 0.032485 Sep 19 11:27:28.119148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 202/401] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:28 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:27:28.124389 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-73a6e4c0-e68d-4d47-9e6f-981c0afd0ac9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '.version_select at 0x7ff5216feb80>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:28.149278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-73a6e4c0-e68d-4d47-9e6f-981c0afd0ac9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894629717" status: 204 len: 0 microversion: 2.20 time: 0.028976 Sep 19 11:27:28.153714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 200/402] 10.222.0.81 () {60 vars in 1259 bytes} [Mon Sep 19 11:27:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894629717 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 11:27:29.051448 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d0d199eb-b249-4d55-83a9-0cb259b724e7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'create', calling method: .version_select at 0x7ff5215da700>, body: {"keypair": {"name": "tempest-keypair-942479834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXSvoc29ePQtTkO03JjT4GNBLcvJuQUkT9f1cLTp78L0XiRoZYQyKklTE3VSm6897g9RHMq8sGL8f4VLQZ1fnUxkch3SVaYQAljlAqjRptIh0otKjt43VimOZs0oW0J0A=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:29.067352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-d0d199eb-b249-4d55-83a9-0cb259b724e7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for project 078bf59c33cc43579aeb270262079a37. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:29.071184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-d0d199eb-b249-4d55-83a9-0cb259b724e7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for user a3097d9c130746ca840bf85f33bc006b and project 078bf59c33cc43579aeb270262079a37. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:29.092832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d0d199eb-b249-4d55-83a9-0cb259b724e7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045816 Sep 19 11:27:29.093485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 203/403] 10.222.0.81 () {62 vars in 1200 bytes} [Mon Sep 19 11:27:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 11:27:30.359315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2099652759", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3f42746-643a-44f8-bda0-c0503923c439"}], "security_groups": [{"name": "tempest-securitygroup--662745827"}], "key_name": "tempest-keypair-942479834", "user_data": "}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:30.461612 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] validate_networks() for [('f3f42746-643a-44f8-bda0-c0503923c439', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:27:30.830961 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:27:30.831391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:27:30.831899 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:27:30.832317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:27:30.832728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:27:30.841429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:30.841908 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:30.842350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:30.843075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:30.843532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:30.843995 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:30.860441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for project 078bf59c33cc43579aeb270262079a37. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:30.864373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Getting quotas for user a3097d9c130746ca840bf85f33bc006b and project 078bf59c33cc43579aeb270262079a37. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:30.875148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:27:30.878271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:27:30.926388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6648cb75-0a4a-48c7-a6a0-c6449c87a631 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.571920 Sep 19 11:27:30.927040 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 201/404] 10.222.0.81 () {62 vars in 1188 bytes} [Mon Sep 19 11:27:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 11:27:30.938624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3f50d960-70c5-4518-aed6-f6bc3404d3dc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:30.939868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3f50d960-70c5-4518-aed6-f6bc3404d3dc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:30.996456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3f50d960-70c5-4518-aed6-f6bc3404d3dc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.004257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3f50d960-70c5-4518-aed6-f6bc3404d3dc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.005697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3f50d960-70c5-4518-aed6-f6bc3404d3dc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.006780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3f50d960-70c5-4518-aed6-f6bc3404d3dc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1281 microversion: 2.20 time: 0.072694 Sep 19 11:27:31.007334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 204/405] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:30 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:32.032124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:32.032736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:32.039631 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:32.040275 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:32.040718 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:32.041418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:32.041907 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:32.042333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:32.119702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:32.128900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:32.130511 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:32.131793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d49469d7-07cb-45e3-82bf-4b9be4e82079 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1333 microversion: 2.20 time: 0.104182 Sep 19 11:27:32.132429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 202/406] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:32 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:33.156951 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:33.157531 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:33.163755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:33.164274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:33.164728 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.165419 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:33.166058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:33.166660 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.374042 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:33.384206 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:33.385827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:33.386981 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a32b6649-9c54-474c-958a-f5b1cb294e53 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.234022 Sep 19 11:27:33.387540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 205/407] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:33 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:34.134712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-47a8a848-6495-4f90-88f8-08452e598cc3 req-2a06b336-fe64-4079-a2eb-02d49d99996c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:34.146564 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-47a8a848-6495-4f90-88f8-08452e598cc3 req-2a06b336-fe64-4079-a2eb-02d49d99996c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:34.147040 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-47a8a848-6495-4f90-88f8-08452e598cc3 req-2a06b336-fe64-4079-a2eb-02d49d99996c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:34.147474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-47a8a848-6495-4f90-88f8-08452e598cc3 req-2a06b336-fe64-4079-a2eb-02d49d99996c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:34.159745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-47a8a848-6495-4f90-88f8-08452e598cc3 req-2a06b336-fe64-4079-a2eb-02d49d99996c service nova] Creating event network-changed:34189864-79e6-4de2-a6e6-1f4a5a6f5640 for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f on hv-cinder-82099 Sep 19 11:27:34.165189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-47a8a848-6495-4f90-88f8-08452e598cc3 req-2a06b336-fe64-4079-a2eb-02d49d99996c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034047 Sep 19 11:27:34.165784 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 203/408] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:34.412384 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:34.413142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:34.419591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:34.420120 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:34.420556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:34.421238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:34.421687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:34.422109 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:34.618018 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.627095 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.629115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.630237 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1fd4f5e3-f113-4da9-a0c7-bcf13203cd79 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.222394 Sep 19 11:27:34.630795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 206/409] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:34 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:35.660413 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:35.661220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:35.668249 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.668744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.669219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.669940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.670715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.671147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.884451 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.898083 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.899492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.900640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0c5f3dd6-4d81-4386-b477-fd445e1cbe4b tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.249041 Sep 19 11:27:35.901290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 204/410] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:35 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:36.926802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:36.927445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:36.933876 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:36.934364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:36.934803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:36.935501 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:36.936329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:36.936761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:37.073079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:37.081704 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:37.083237 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:37.084444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-56d4e5e6-0590-449c-8e8f-8199e7d8fb0a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.161928 Sep 19 11:27:37.085005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 207/411] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:36 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:38.108866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:38.109485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:38.115573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:38.116098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:38.116547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:38.117245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:38.117715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:38.118152 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:38.251543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:38.261020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:38.262488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:38.263639 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-92448b8a-63e5-4d4c-90a4-0eb9436ab74d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.158660 Sep 19 11:27:38.264240 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 205/412] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:38 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:39.288253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:39.288851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:39.291310 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:39.297316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:39.297797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:39.298233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:39.299872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:39.299872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:39.299872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:39.432033 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:39.440756 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:39.442214 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:39.443324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4c354ca5-0443-4090-b44d-3e128fdbeea2 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.158991 Sep 19 11:27:39.443909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 208/413] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:39 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:40.138693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-9e85b4c0-300b-4ee6-860a-4979975d61ce req-fec8b009-9e39-457a-8bcf-7cb9e0e5a2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "name": "network-vif-plugged", "status": "completed", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:40.150970 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-9e85b4c0-300b-4ee6-860a-4979975d61ce req-fec8b009-9e39-457a-8bcf-7cb9e0e5a2f4 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:40.151459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-9e85b4c0-300b-4ee6-860a-4979975d61ce req-fec8b009-9e39-457a-8bcf-7cb9e0e5a2f4 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:40.151939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-9e85b4c0-300b-4ee6-860a-4979975d61ce req-fec8b009-9e39-457a-8bcf-7cb9e0e5a2f4 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:40.163724 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-9e85b4c0-300b-4ee6-860a-4979975d61ce req-fec8b009-9e39-457a-8bcf-7cb9e0e5a2f4 service nova] Creating event network-vif-plugged:34189864-79e6-4de2-a6e6-1f4a5a6f5640 for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f on hv-cinder-82099 Sep 19 11:27:40.168643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-9e85b4c0-300b-4ee6-860a-4979975d61ce req-fec8b009-9e39-457a-8bcf-7cb9e0e5a2f4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033629 Sep 19 11:27:40.169274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 206/414] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:40.468156 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:40.468766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:40.475665 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:40.476182 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:40.476616 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:40.477305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:40.477759 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:40.478184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:40.604022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:40.606279 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:40.613800 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:40.615251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:40.616469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f98cf626-be2b-48d5-9d93-69a9b3fa15e1 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.152186 Sep 19 11:27:40.617242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 209/415] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:40 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:41.638629 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:41.639449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:41.645041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:41.645771 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:41.653029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.655719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.655719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:41.655719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.655719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.656109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:41.658336 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=93 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:41.791480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:41.799489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:41.800995 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:41.802089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-73f10c61-7a9d-4c33-a8b5-2d5fab55add4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1406 microversion: 2.20 time: 0.164524 Sep 19 11:27:41.802642 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 207/416] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:41 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:42.826403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:42.827059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:42.829388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:42.836233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:42.836717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:42.837156 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:42.837842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:42.838295 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:42.838718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:42.964388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:42.973063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:42.974499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:42.975643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-27d50e5a-abe5-4bd1-aaf9-4f62250b87fc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1598 microversion: 2.20 time: 0.153129 Sep 19 11:27:42.976241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 210/417] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:42 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:42.999752 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:43.000309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:43.007535 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.008045 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.008480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.009168 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.009621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.010043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.090255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ccccbe3c-b036-4266-ab0f-b8c81d0ec840 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094286 Sep 19 11:27:43.090891 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 208/418] 10.222.0.81 () {60 vars in 1316 bytes} [Mon Sep 19 11:27:42 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:27:44.009386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-5579b29f-1b26-4203-abe7-f6eec9c73c2b req-68619d69-41f1-4210-b149-a831400fe8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:44.019936 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-5579b29f-1b26-4203-abe7-f6eec9c73c2b req-68619d69-41f1-4210-b149-a831400fe8ac service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:44.020454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-5579b29f-1b26-4203-abe7-f6eec9c73c2b req-68619d69-41f1-4210-b149-a831400fe8ac service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:44.020890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-5579b29f-1b26-4203-abe7-f6eec9c73c2b req-68619d69-41f1-4210-b149-a831400fe8ac service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:44.034612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-5579b29f-1b26-4203-abe7-f6eec9c73c2b req-68619d69-41f1-4210-b149-a831400fe8ac service nova] Creating event network-changed:34189864-79e6-4de2-a6e6-1f4a5a6f5640 for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f on hv-cinder-82099 Sep 19 11:27:44.039713 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-5579b29f-1b26-4203-abe7-f6eec9c73c2b req-68619d69-41f1-4210-b149-a831400fe8ac service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033982 Sep 19 11:27:44.040400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 211/419] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:47.668897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:47.669447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:47.671233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:47.677470 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:47.677961 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:47.678400 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:47.679104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:47.679559 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:47.680014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:47.760250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lazy-loading 'services' on Instance uuid e6be205d-fa54-491f-87bf-159cda85b1c3 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:27:47.870512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9a3bc1e4-d478-44e8-980d-a6bd124379da tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments/4c50b3b5-09a3-4e2d-9f9f-cc4414f10438" status: 202 len: 0 microversion: 2.1 time: 0.205880 Sep 19 11:27:47.871108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 209/420] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:27:47 2022] DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments/4c50b3b5-09a3-4e2d-9f9f-cc4414f10438 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:47.880721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:47.882880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:47.889104 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:47.889581 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:47.890020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:47.890715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:47.891173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:47.891601 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:47.922869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c42fae85-ebe8-47bd-aab0-95dd3661d440 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 Sep 19 11:27:47.927704 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 212/421] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:27:47 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:48.935145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:48.937559 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:48.944299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:48.944796 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:48.945240 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:48.945936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:48.946395 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:48.946830 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:48.976110 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0fcf6745-251a-4169-8e95-64744d90ed9b tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045268 Sep 19 11:27:48.976666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 210/422] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:27:48 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:27:49.053299 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:49.053990 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:49.060132 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.060617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.061055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.061740 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.062192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.062617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.087301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:27:49.164879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4869bf29-0285-4302-bc4d-d03c513ec956 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 204 len: 0 microversion: 2.1 time: 0.115741 Sep 19 11:27:49.165471 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 213/423] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:27:49 2022] DELETE /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:27:49.174768 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:49.175394 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:49.181294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.181783 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.182229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.182918 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.183383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.183869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.315144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:49.322766 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8495cfdb-dbce-4d93-9d92-557216ef19b2 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1686 microversion: 2.1 time: 0.152920 Sep 19 11:27:49.323330 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 211/424] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:49 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:50.348420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:50.349034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:50.355174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:50.355666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:50.356172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:50.356871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:50.357328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:50.357783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:50.491792 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:50.499439 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5ab5621f-0d32-4bf4-ba49-5966dcf9bd78 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1686 microversion: 2.1 time: 0.156228 Sep 19 11:27:50.500038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 214/425] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:50 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:51.522395 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:51.522998 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:51.529311 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:51.529808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:51.530243 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:51.530929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:51.531387 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:51.531831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:51.660265 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:51.679072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-98650393-92a5-45d1-8db4-a41ac22c90fb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1686 microversion: 2.1 time: 0.160460 Sep 19 11:27:51.679651 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 212/426] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:51 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:52.701790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:52.702395 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:52.709662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.710139 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.710577 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.711255 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.711782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.712211 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.844305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:52.852733 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-042d8214-2ad8-41e0-8e89-c5e425fc8691 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1686 microversion: 2.1 time: 0.154781 Sep 19 11:27:52.853476 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 215/427] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:52 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:52.857220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:52.859316 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:52.866224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.866710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.867148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.867856 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.868313 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.868740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.896929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1a1387bc-4844-4327-83e8-7a57e78da1e6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043675 Sep 19 11:27:52.897467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 213/428] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:27:52 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 11:27:52.959972 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:52.960475 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:52.966354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.966842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.967284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.968004 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.968473 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.968901 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.994542 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:27:53.070796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c67a401b-bd0e-4c87-8f16-1d77ccdecf8c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 204 len: 0 microversion: 2.1 time: 0.114361 Sep 19 11:27:53.074741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 216/429] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:27:52 2022] DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:27:53.079756 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:53.080656 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:53.086703 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.087203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.087640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.088369 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.088828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.089265 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.307011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:53.314721 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e92f3694-7a28-4aab-9921-11874defe498 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1674 microversion: 2.1 time: 0.238805 Sep 19 11:27:53.315284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 214/430] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:53 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:53.878374 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:53.879306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:53.887393 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.887995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.888533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.889469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.890030 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.890559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.890820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-0c727f28-e88b-4b67-9b6c-843589cd99d2 req-560428ee-7b88-409a-822a-f9ee0b630ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6be205d-fa54-491f-87bf-159cda85b1c3", "name": "network-vif-deleted", "tag": "7caf44f4-6ec4-453f-b026-5ce545b8b513"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:53.901090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0c727f28-e88b-4b67-9b6c-843589cd99d2 req-560428ee-7b88-409a-822a-f9ee0b630ff3 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.901570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0c727f28-e88b-4b67-9b6c-843589cd99d2 req-560428ee-7b88-409a-822a-f9ee0b630ff3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.902007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0c727f28-e88b-4b67-9b6c-843589cd99d2 req-560428ee-7b88-409a-822a-f9ee0b630ff3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.913688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-0c727f28-e88b-4b67-9b6c-843589cd99d2 req-560428ee-7b88-409a-822a-f9ee0b630ff3 service nova] Creating event network-vif-deleted:7caf44f4-6ec4-453f-b026-5ce545b8b513 for instance e6be205d-fa54-491f-87bf-159cda85b1c3 on hv-cinder-82099 Sep 19 11:27:53.919359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-0c727f28-e88b-4b67-9b6c-843589cd99d2 req-560428ee-7b88-409a-822a-f9ee0b630ff3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Sep 19 11:27:53.920555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 215/431] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:27:53.960383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:53.970384 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-005faf77-e7c5-46ee-990b-6105127f4032 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1619 microversion: 2.1 time: 0.097986 Sep 19 11:27:53.970969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 217/432] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:53 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1619 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:54.339741 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:54.340464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:54.346658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:54.347145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:54.347647 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:54.348321 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:54.348785 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:54.349210 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:54.481539 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:54.490098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d11885e9-ef16-432a-ae23-4d7361e5cbab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1674 microversion: 2.1 time: 0.154640 Sep 19 11:27:54.490978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 216/433] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:54 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:54.993398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:54.994005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:55.000386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:55.000870 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:55.001308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:55.001988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:55.002447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:55.002868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:55.066609 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:55.075503 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b568f1a5-613e-4ea4-a4a6-4bc7e93fbce4 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 200 len: 1619 microversion: 2.1 time: 0.085988 Sep 19 11:27:55.076111 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 218/434] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:54 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 1619 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:55.513971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:55.514671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:55.521868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:55.522876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:55.523361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:55.524056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:55.524522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:55.524953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:55.751890 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:55.759435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1b7f48a8-4aa7-4ea7-a458-774b2c8a57b5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1674 microversion: 2.1 time: 0.249855 Sep 19 11:27:55.760034 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 217/435] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:55 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:56.101187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:56.101817 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: e6be205d-fa54-491f-87bf-159cda85b1c3] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:56.108519 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.109017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.109460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.110163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.110626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.111060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.124527 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] HTTP exception thrown: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 could not be found. Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Request method failure captured: Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 HTTP/1.1 Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE719UvpezPNvQaaanqD4PcCWo6l7Ntm0rvI7ztghwwneiFW7ghElnLw9QbHp-IlsoDFFdAPcvtvYgjLrXmu5JnecRrD4N6situzQJt9sGXI3kLio4zbKRcoF9TxyIas68Ga33TugbFY3Kwz6QLzMiSSTLbBn4Mqh-aautQRHBERFo Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:27:56.126687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c7ccdce201f547f5a50c93e27c5e8cb1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}] Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 9f160368e1984319ad4fa37c2794a956 Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 could not be found. Sep 19 11:27:56.128301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'e6be205d-fa54-491f-87bf-159cda85b1c3'} Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 could not be found. Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:27:56.129110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 could not be found. Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 could not be found. Sep 19 11:27:56.130289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:56.131459 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Returning 404 to user: Instance e6be205d-fa54-491f-87bf-159cda85b1c3 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:27:56.131459 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a306e319-cf81-4746-9aff-b9a17b05462a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3" status: 404 len: 111 microversion: 2.1 time: 0.030809 Sep 19 11:27:56.131459 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 219/436] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:56 2022] GET /compute/v2.1/servers/e6be205d-fa54-491f-87bf-159cda85b1c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:27:56.137150 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b337a4b5-92ce-482d-8da9-33d21cb32339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '.version_select at 0x7ff5216a44c0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:56.156521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b337a4b5-92ce-482d-8da9-33d21cb32339 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604998255" status: 202 len: 0 microversion: 2.1 time: 0.023179 Sep 19 11:27:56.157103 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 218/437] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 11:27:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604998255 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:56.646504 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-0e209f6a-cc82-4171-84aa-74a4058ee1b2 req-5e5128ca-c9ef-4572-99c0-75a1c5c40188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1", "name": "network-vif-deleted", "tag": "be6dcfdf-14a9-42c6-8271-941d034d3349"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:56.663550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-0e209f6a-cc82-4171-84aa-74a4058ee1b2 req-5e5128ca-c9ef-4572-99c0-75a1c5c40188 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.664373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-0e209f6a-cc82-4171-84aa-74a4058ee1b2 req-5e5128ca-c9ef-4572-99c0-75a1c5c40188 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.664977 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-0e209f6a-cc82-4171-84aa-74a4058ee1b2 req-5e5128ca-c9ef-4572-99c0-75a1c5c40188 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.699627 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-0e209f6a-cc82-4171-84aa-74a4058ee1b2 req-5e5128ca-c9ef-4572-99c0-75a1c5c40188 service nova] Creating event network-vif-deleted:be6dcfdf-14a9-42c6-8271-941d034d3349 for instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 on hv-cinder-82099 Sep 19 11:27:56.707075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-0e209f6a-cc82-4171-84aa-74a4058ee1b2 req-5e5128ca-c9ef-4572-99c0-75a1c5c40188 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064109 Sep 19 11:27:56.708544 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 220/438] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:56.783662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:56.784643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:56.797302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.798310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.798992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.800204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.800849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.802085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.872323 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.872815 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.873259 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.873713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lazy-loading 'fault' on Instance uuid fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:27:56.958953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:56.967521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-be8863c7-f238-42a8-a99d-dbadaad4f8d2 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 200 len: 1328 microversion: 2.1 time: 0.188628 Sep 19 11:27:56.983915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 219/439] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:56 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 1328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:57.991137 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:57.991855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:57.998440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:57.998927 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:57.999369 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:58.000081 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:58.000539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:58.000970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:58.013816 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] HTTP exception thrown: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Request method failure captured: Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 HTTP/1.1 Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE6UvhJJygs09S9byDFLXqmFboyqbJZDKVGIGtZajwG7Tz2xqog9cV6Smvn-dqacnKHtFtJHvwzH--ojDcmCNezCb60cR_9nNSwmSW8hw5Y-FD6RQLaj_ZJbjgMq1_npgCkhtJi00Qnd1-hrxyX9QtPFHpmCG34tUphsGmUNKXuVnA Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:27:58.015336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8a952d8324548d7a8e80f72449ea5e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}] Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 9a4a7aca62974db38138a38de399139f Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:27:58.017377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1'} Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:27:58.018285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:27:58.019679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:27:58.020940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Returning 404 to user: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:27:58.020940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ade1befd-7a5f-43d4-a3fe-d756bea2b50d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 404 len: 111 microversion: 2.1 time: 0.029802 Sep 19 11:27:58.020940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 221/440] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:57 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:27:58.026237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-526e551b-c8aa-4fcd-8736-38d30f0f0e28 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '.version_select at 0x7ff5216a4550>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:58.045989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-526e551b-c8aa-4fcd-8736-38d30f0f0e28 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935280940" status: 202 len: 0 microversion: 2.1 time: 0.023568 Sep 19 11:27:58.046580 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 220/441] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 11:27:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935280940 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:58.694529 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-013858e6-b316-4ad9-8701-558f2049a2c6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: .version_select at 0x7ff521606160>, body: {"keypair": {"name": "tempest-keypair-689379936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKch2DPAtQQUMXeGcl6sRHOL5b+tLxWVNS3L+nXlU/rHI0v2litoiZ/6+ReSq9X3ByD8fUzgTqgZqkVlixDBekBbDBGlMOIobXy79oR+shaYfb/vHP0P4cuc1vrgMhdfLw=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:58.710412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-013858e6-b316-4ad9-8701-558f2049a2c6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:58.714221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-013858e6-b316-4ad9-8701-558f2049a2c6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for user 9a4a7aca62974db38138a38de399139f and project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:58.736073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-013858e6-b316-4ad9-8701-558f2049a2c6 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045347 Sep 19 11:27:58.736697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 222/442] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:27:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:59.281793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:59.282388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:59.289092 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:59.289862 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:59.290271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:59.291065 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:59.291572 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:59.292028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:59.319113 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:27:59.394636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-11e1ea58-7531-4fb5-89ad-f6481b1a7030 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 204 len: 0 microversion: 2.1 time: 0.116551 Sep 19 11:27:59.399071 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 221/443] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:27:59 2022] DELETE /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:27:59.405071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:59.406988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:59.413975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:59.414473 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:59.414911 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:59.415609 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:59.416189 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:59.416597 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:59.553203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:59.560979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-70f65276-718d-4177-9327-20ddcf45d305 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1507 microversion: 2.1 time: 0.160654 Sep 19 11:27:59.561553 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 223/444] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:59 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:00.192915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-91136338", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79977212-9704-4425-8d7a-e6522d6f3c5b"}], "security_groups": [{"name": "tempest-securitygroup--1274841413"}], "key_name": "tempest-keypair-689379936", "user_data": "}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:00.293057 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] validate_networks() for [('79977212-9704-4425-8d7a-e6522d6f3c5b', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:28:00.585122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:00.585764 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:00.592250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:00.592743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:00.593185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:00.593884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:00.594348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:00.595478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:00.697839 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:28:00.698259 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:28:00.698746 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:28:00.699132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:28:00.699548 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:28:00.709094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:00.709574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:00.710006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:00.710728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:00.711180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:00.711600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:00.729573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:28:00.734014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Getting quotas for user 9a4a7aca62974db38138a38de399139f and project e8a952d8324548d7a8e80f72449ea5e6. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:28:00.745935 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:28:00.746158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:00.748472 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:28:00.753916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9a912453-cebc-4320-a6b7-86a2db8b25d0 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1507 microversion: 2.1 time: 0.172635 Sep 19 11:28:00.754486 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 224/445] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:00 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:00.794506 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ad532895-26fb-4401-9112-932fe16edf02 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606718 Sep 19 11:28:00.795154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 222/446] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:28:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:28:00.807214 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ce974e61-262e-4c51-94c7-ed8f67aad5ab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:00.807940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ce974e61-262e-4c51-94c7-ed8f67aad5ab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:00.868011 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ce974e61-262e-4c51-94c7-ed8f67aad5ab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:00.877621 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ce974e61-262e-4c51-94c7-ed8f67aad5ab tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1235 microversion: 2.1 time: 0.074030 Sep 19 11:28:00.878442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 225/447] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:00 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1235 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:01.777037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:01.777678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:01.783941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:01.784429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:01.784866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:01.785549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:01.785999 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:01.786425 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:01.900886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:01.901496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:01.907926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:01.908410 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:01.908846 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:01.909541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:01.910000 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:01.910441 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:01.916599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:01.924957 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-fb07ad5b-ee67-465f-8814-b67224f29e76 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1507 microversion: 2.1 time: 0.152221 Sep 19 11:28:01.925466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 223/448] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:01 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:01.990881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:01.999411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9cad666c-7a77-41e7-a22d-95e26843dc85 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1287 microversion: 2.1 time: 0.102377 Sep 19 11:28:02.000031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 226/449] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:01 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:02.437110 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-f20460e5-eb2d-481d-805e-a05b5cb5fa93 req-5883a5f1-7315-4721-a7ab-28c76ac453dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1fde0ab-90d4-496f-8d81-15056c43a44e", "name": "network-vif-deleted", "tag": "f759b9af-a4de-46a2-b77f-a99514276d61"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:02.450537 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f20460e5-eb2d-481d-805e-a05b5cb5fa93 req-5883a5f1-7315-4721-a7ab-28c76ac453dc service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.451314 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f20460e5-eb2d-481d-805e-a05b5cb5fa93 req-5883a5f1-7315-4721-a7ab-28c76ac453dc service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.451966 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f20460e5-eb2d-481d-805e-a05b5cb5fa93 req-5883a5f1-7315-4721-a7ab-28c76ac453dc service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.464622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-f20460e5-eb2d-481d-805e-a05b5cb5fa93 req-5883a5f1-7315-4721-a7ab-28c76ac453dc service nova] Creating event network-vif-deleted:f759b9af-a4de-46a2-b77f-a99514276d61 for instance c1fde0ab-90d4-496f-8d81-15056c43a44e on hv-cinder-82099 Sep 19 11:28:02.471372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-f20460e5-eb2d-481d-805e-a05b5cb5fa93 req-5883a5f1-7315-4721-a7ab-28c76ac453dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038630 Sep 19 11:28:02.472107 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 224/450] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:02.949194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:02.949852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:02.957176 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.957666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.958107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.958805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.959263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.959694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.993489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.993908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.994346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.994924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lazy-loading 'fault' on Instance uuid c1fde0ab-90d4-496f-8d81-15056c43a44e {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:02.997848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:03.024165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:03.025592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:03.032349 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:03.032915 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:03.033417 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:03.034214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:03.034737 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:03.035228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:03.046157 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:03.050662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:03.056673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7dd04bd1-9726-498f-98b3-14795830bad5 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 200 len: 1311 microversion: 2.1 time: 0.111567 Sep 19 11:28:03.057570 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 227/451] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:02 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:03.122472 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:03.130833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8e46283b-5a77-48c9-90e5-a98f9eab2d99 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1293 microversion: 2.1 time: 0.111420 Sep 19 11:28:03.131412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 225/452] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:03 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1293 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:04.084742 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:04.085456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: c1fde0ab-90d4-496f-8d81-15056c43a44e] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:04.091718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.092314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.092842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.093600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.094212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.094742 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.113002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] HTTP exception thrown: Instance c1fde0ab-90d4-496f-8d81-15056c43a44e could not be found. Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Request method failure captured: Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e HTTP/1.1 Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE719UvpezPNvQaaanqD4PcCWo6l7Ntm0rvI7ztghwwneiFW7ghElnLw9QbHp-IlsoDFFdAPcvtvYgjLrXmu5JnecRrD4N6situzQJt9sGXI3kLio4zbKRcoF9TxyIas68Ga33TugbFY3Kwz6QLzMiSSTLbBn4Mqh-aautQRHBERFo Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:28:04.114671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c7ccdce201f547f5a50c93e27c5e8cb1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}] Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 9f160368e1984319ad4fa37c2794a956 Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance c1fde0ab-90d4-496f-8d81-15056c43a44e could not be found. Sep 19 11:28:04.115960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'c1fde0ab-90d4-496f-8d81-15056c43a44e'} Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1fde0ab-90d4-496f-8d81-15056c43a44e could not be found. Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:28:04.116708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1fde0ab-90d4-496f-8d81-15056c43a44e could not be found. Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1fde0ab-90d4-496f-8d81-15056c43a44e could not be found. Sep 19 11:28:04.117946 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:28:04.119028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Returning 404 to user: Instance c1fde0ab-90d4-496f-8d81-15056c43a44e could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:28:04.119028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1fb6cbe0-f9da-4894-92eb-bfa4989f9447 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e" status: 404 len: 111 microversion: 2.1 time: 0.035261 Sep 19 11:28:04.119028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 228/453] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:04 2022] GET /compute/v2.1/servers/c1fde0ab-90d4-496f-8d81-15056c43a44e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:28:04.124982 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:04.125680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:04.135670 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.136190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.136628 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.137324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.137781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.138209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.154115 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:04.154837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:04.161103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.161956 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.162497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.163968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.164542 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.165079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.176492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:28:04.268209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6d0ac3fa-c366-480e-b7b3-2c608d5fdd84 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "DELETE /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 204 len: 0 microversion: 2.1 time: 0.146773 Sep 19 11:28:04.269182 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 226/454] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:28:04 2022] DELETE /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:28:04.278350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:04.279051 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:04.285203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.285691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.286129 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.286831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.287281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.287707 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.372321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:04.381034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f4ab6d88-0b5c-44c1-9838-8d69ea8bea9d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.230820 Sep 19 11:28:04.381773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 229/455] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:04 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:04.434443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:04.442637 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0e43cb58-3b4c-48cc-9c54-c71ee7b4fcf6 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.168429 Sep 19 11:28:04.443197 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 227/456] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:04 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:04.485068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-5496dff2-1739-4698-b1c7-c3c6354a1e95 req-1f24eea5-1f1b-4152-82c5-619dc330df38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41ac543-a9ec-414f-a8e8-4d7e39da3faa", "tag": "b7a27a1f-b11e-49b5-8ad6-452d21e318e9"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:04.494322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-5496dff2-1739-4698-b1c7-c3c6354a1e95 req-1f24eea5-1f1b-4152-82c5-619dc330df38 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.494832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-5496dff2-1739-4698-b1c7-c3c6354a1e95 req-1f24eea5-1f1b-4152-82c5-619dc330df38 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.495261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-5496dff2-1739-4698-b1c7-c3c6354a1e95 req-1f24eea5-1f1b-4152-82c5-619dc330df38 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.506108 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-5496dff2-1739-4698-b1c7-c3c6354a1e95 req-1f24eea5-1f1b-4152-82c5-619dc330df38 service nova] Creating event network-changed:b7a27a1f-b11e-49b5-8ad6-452d21e318e9 for instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa on hv-cinder-82099 Sep 19 11:28:04.510943 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-5496dff2-1739-4698-b1c7-c3c6354a1e95 req-1f24eea5-1f1b-4152-82c5-619dc330df38 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029598 Sep 19 11:28:04.511503 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 230/457] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:05.404720 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:05.405344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:05.412380 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:05.412868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:05.413310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:05.414011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:05.414468 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:05.414895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:05.467071 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:05.467944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:05.474771 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:05.475341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:05.475847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:05.476527 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:05.476978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:05.477408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:05.583873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:05.591496 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ab34cded-18ee-48b2-8c16-6edcd0702d30 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.190632 Sep 19 11:28:05.592100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 228/458] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:05 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:05.628009 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:05.635587 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8c6c4a10-ec90-4da8-b516-b759382686eb tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.173273 Sep 19 11:28:05.636191 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 231/459] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:05 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:06.615311 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:06.615971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:06.627573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.627573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.627573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.627573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.628118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.628118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.658882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:06.659947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:06.666256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.666763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.667211 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.667939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.668398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.669174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.810983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:06.819349 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-09d9b4b5-5fe7-47aa-9288-943006357f2d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.207854 Sep 19 11:28:06.819941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 229/460] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:06 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:06.836316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:06.844037 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d00302c1-38a3-4ae5-a92b-46f444d9d386 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.189023 Sep 19 11:28:06.844621 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 232/461] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:06 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:07.843543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:07.844211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:07.850686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:07.851175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:07.851611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:07.852350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:07.852805 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:07.853235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:07.866037 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:07.866654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:07.873041 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:07.873528 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:07.873968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:07.874666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:07.875124 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:07.875574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:08.046940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:08.055664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6ffb661b-7453-4713-9932-14e7ca61107f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.215934 Sep 19 11:28:08.056274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 230/462] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:07 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:08.061315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:08.069544 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-904d5401-d1c9-4429-b3ea-7ea28f2571a3 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.207407 Sep 19 11:28:08.070141 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 233/463] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:07 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:09.078139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:09.079359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:09.086014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.086518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.086955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.087645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.088135 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.088561 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.092929 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:09.093819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:09.101398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.102204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.102727 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.103794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.104432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.104864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.470676 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f160368e1984319ad4fa37c2794a956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7ccdce201f547f5a50c93e27c5e8cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:09.478784 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-34606dee-f8e7-4d0e-8a04-cef9c216f814 tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 200 len: 1520 microversion: 2.1 time: 0.389859 Sep 19 11:28:09.479375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 234/464] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:09 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:09.483190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:09.491347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e6c3592b-397e-4c51-ac2e-0f211a8aa3c3 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.417012 Sep 19 11:28:09.504137 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 231/465] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:09 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:09.671463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-c494aaa0-a8df-418d-8852-c03ef1c5fd0e req-3b07fe5e-e51a-4415-bb33-887ef11de16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781f01d3-aa65-40ad-9c85-0e93e6f05745", "name": "network-vif-deleted", "tag": "d8d9d58e-5f33-4c6e-bba4-32413e04606d"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:09.677656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:09.683626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c494aaa0-a8df-418d-8852-c03ef1c5fd0e req-3b07fe5e-e51a-4415-bb33-887ef11de16c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.684387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c494aaa0-a8df-418d-8852-c03ef1c5fd0e req-3b07fe5e-e51a-4415-bb33-887ef11de16c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.684944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c494aaa0-a8df-418d-8852-c03ef1c5fd0e req-3b07fe5e-e51a-4415-bb33-887ef11de16c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.698187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-c494aaa0-a8df-418d-8852-c03ef1c5fd0e req-3b07fe5e-e51a-4415-bb33-887ef11de16c service nova] Creating event network-vif-deleted:d8d9d58e-5f33-4c6e-bba4-32413e04606d for instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 on hv-cinder-82099 Sep 19 11:28:09.703453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-c494aaa0-a8df-418d-8852-c03ef1c5fd0e req-3b07fe5e-e51a-4415-bb33-887ef11de16c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036063 Sep 19 11:28:09.705320 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 235/466] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:10.502354 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:10.502963 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] [instance: 781f01d3-aa65-40ad-9c85-0e93e6f05745] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:10.509485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.509976 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.510416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.511115 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.511571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.512029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.515464 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:10.516863 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:10.526044 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.526493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] HTTP exception thrown: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 could not be found. Sep 19 11:28:10.526630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.527162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.528135 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Request method failure captured: Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 HTTP/1.1 Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE719UvpezPNvQaaanqD4PcCWo6l7Ntm0rvI7ztghwwneiFW7ghElnLw9QbHp-IlsoDFFdAPcvtvYgjLrXmu5JnecRrD4N6situzQJt9sGXI3kLio4zbKRcoF9TxyIas68Ga33TugbFY3Kwz6QLzMiSSTLbBn4Mqh-aautQRHBERFo Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:28:10.528246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c7ccdce201f547f5a50c93e27c5e8cb1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c7ccdce201f547f5a50c93e27c5e8cb1"}]}] Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: c7ccdce201f547f5a50c93e27c5e8cb1 Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1472043871 Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 9f160368e1984319ad4fa37c2794a956 Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1472043871-project Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 could not be found. Sep 19 11:28:10.529734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '781f01d3-aa65-40ad-9c85-0e93e6f05745'} Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 could not be found. Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:28:10.530512 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 could not be found. Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 could not be found. Sep 19 11:28:10.531823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:28:10.532819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.532904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] Returning 404 to user: Instance 781f01d3-aa65-40ad-9c85-0e93e6f05745 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:28:10.532987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.533061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8c02b0a0-4ff3-4fa1-b7c7-0fad95d2751a tempest-ServerRescueNegativeTestJSON-1472043871 tempest-ServerRescueNegativeTestJSON-1472043871-project] 10.222.0.81 "GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745" status: 404 len: 111 microversion: 2.1 time: 0.031768 Sep 19 11:28:10.533061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 232/467] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:10 2022] GET /compute/v2.1/servers/781f01d3-aa65-40ad-9c85-0e93e6f05745 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:28:10.670426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:10.680565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d6d716ad-3bc7-4dfb-9bfd-068cfb7ba65c tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.169830 Sep 19 11:28:10.695965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 236/468] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:10 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:11.702688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:11.703224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:11.705446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:11.706138 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:11.713056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:11.713550 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:11.713997 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:11.714698 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:11.715165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:11.715600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:11.848102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:11.856715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-efe01998-6830-4d2c-b629-041cb6449dc1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.158052 Sep 19 11:28:11.857287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 233/469] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:11 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:12.372778 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-c71e7656-0c6e-47de-b7d8-b19b950a03ac req-b50f08f7-7e08-4c9b-bf4e-9fb03a05cbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41ac543-a9ec-414f-a8e8-4d7e39da3faa", "name": "network-vif-plugged", "status": "completed", "tag": "b7a27a1f-b11e-49b5-8ad6-452d21e318e9"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:12.391546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:12.395881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c71e7656-0c6e-47de-b7d8-b19b950a03ac req-b50f08f7-7e08-4c9b-bf4e-9fb03a05cbfe service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.396678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c71e7656-0c6e-47de-b7d8-b19b950a03ac req-b50f08f7-7e08-4c9b-bf4e-9fb03a05cbfe service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.397489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c71e7656-0c6e-47de-b7d8-b19b950a03ac req-b50f08f7-7e08-4c9b-bf4e-9fb03a05cbfe service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:12.411473 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-c71e7656-0c6e-47de-b7d8-b19b950a03ac req-b50f08f7-7e08-4c9b-bf4e-9fb03a05cbfe service nova] Creating event network-vif-plugged:b7a27a1f-b11e-49b5-8ad6-452d21e318e9 for instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa on hv-cinder-82099 Sep 19 11:28:12.419268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-c71e7656-0c6e-47de-b7d8-b19b950a03ac req-b50f08f7-7e08-4c9b-bf4e-9fb03a05cbfe service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053607 Sep 19 11:28:12.420526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 237/470] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:12.882195 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:12.883483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:12.892740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.893714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.894449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:12.895151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.895611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.896070 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:13.036528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:13.044094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d6e16699-4f48-4900-b7ee-e3680bbe1270 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.166697 Sep 19 11:28:13.044659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 234/471] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:12 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:14.067623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:14.068493 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:14.075180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.075668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.076142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.076839 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.077302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.077731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.240887 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:14.248902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6f13c90b-c5df-4deb-b211-40c3ebcc0aa5 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1361 microversion: 2.1 time: 0.186036 Sep 19 11:28:14.249491 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 238/472] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:14 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:15.272981 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:15.284659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:15.291210 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.291708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.292180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.292886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.293352 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.293781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.452993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:15.462644 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-aa9eedf7-203d-4662-934c-f91e3f6cdfdb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1548 microversion: 2.1 time: 0.193463 Sep 19 11:28:15.463239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 235/473] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:15 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1548 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:15.491911 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:15.493354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:15.500643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.501132 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.501568 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.502332 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.503008 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.503727 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.588713 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5f789ed7-1e89-4831-90cb-0ddf88042d7f tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106770 Sep 19 11:28:15.590152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 239/474] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:28:15 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:16.646453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-6cda620d-bb29-4e5e-8508-6763138e59da req-fdb062fb-8aab-401e-8018-26d68a629f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b41ac543-a9ec-414f-a8e8-4d7e39da3faa", "tag": "b7a27a1f-b11e-49b5-8ad6-452d21e318e9"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:16.661650 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6cda620d-bb29-4e5e-8508-6763138e59da req-fdb062fb-8aab-401e-8018-26d68a629f91 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.662363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6cda620d-bb29-4e5e-8508-6763138e59da req-fdb062fb-8aab-401e-8018-26d68a629f91 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.662781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6cda620d-bb29-4e5e-8508-6763138e59da req-fdb062fb-8aab-401e-8018-26d68a629f91 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.679827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-6cda620d-bb29-4e5e-8508-6763138e59da req-fdb062fb-8aab-401e-8018-26d68a629f91 service nova] Creating event network-changed:b7a27a1f-b11e-49b5-8ad6-452d21e318e9 for instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa on hv-cinder-82099 Sep 19 11:28:16.710765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-6cda620d-bb29-4e5e-8508-6763138e59da req-fdb062fb-8aab-401e-8018-26d68a629f91 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069403 Sep 19 11:28:16.715259 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 236/475] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:19.944089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-72415a4e-30e9-45e5-a316-04c261ef3b0f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: .version_select at 0x7ff521642310>, body: {"keypair": {"name": "tempest-keypair-2003002564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf/mry8x8S+Tnkp+VmyRpRueTo3Ffx4GFRtOI+83s0VKL8pnGjpQ9rPeexCqbWs86WGQolQY2mQFv5P/ZTj7aFVoYTTqNIGq9rR/nnYozUiFUWDoUDs+/jd3QC5stHztw=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:19.960911 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-72415a4e-30e9-45e5-a316-04c261ef3b0f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:28:19.964959 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-72415a4e-30e9-45e5-a316-04c261ef3b0f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:28:19.990855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-72415a4e-30e9-45e5-a316-04c261ef3b0f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178485 Sep 19 11:28:19.991472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 240/476] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:28:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:21.264933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1857151156", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bd047f8-e757-4211-9ab1-9e25ad2c412a"}], "security_groups": [{"name": "tempest-securitygroup--609161400"}], "key_name": "tempest-keypair-2003002564", "user_data": "}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:21.273487 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:21.372044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] validate_networks() for [('4bd047f8-e757-4211-9ab1-9e25ad2c412a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:28:21.803929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:28:21.804382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:28:21.805046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:28:21.805459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:28:21.805871 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:28:21.815237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.815745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.816222 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.816971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.817925 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.818060 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.835881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:28:21.840232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:28:21.851381 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:28:21.853845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:28:21.903967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8312500c-9c3b-4c68-a7d3-b43432e49665 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644142 Sep 19 11:28:21.907931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 237/477] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:28:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:28:21.915645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-180e42c7-9b96-4272-a841-33f1e35571a6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:21.916290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-180e42c7-9b96-4272-a841-33f1e35571a6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:21.974093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-180e42c7-9b96-4272-a841-33f1e35571a6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:21.983792 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-180e42c7-9b96-4272-a841-33f1e35571a6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1242 microversion: 2.1 time: 0.072074 Sep 19 11:28:21.993063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 241/478] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:21 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:23.007395 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:23.008658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:23.027858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.028388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.028825 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.029701 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.030151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.030574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.158319 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:23.172870 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-59e06c3b-9389-4d38-aef3-8d90d1ea1207 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1302 microversion: 2.1 time: 0.169372 Sep 19 11:28:23.174093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 238/479] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:23 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1302 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:24.203029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:24.203685 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:24.212075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.212572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.213012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.213715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.214175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.214603 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.518035 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:24.526662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7d4e0a1d-c0c7-4938-9a6b-a409d9e73cc3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.329369 Sep 19 11:28:24.527240 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 242/480] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:24 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:24.862286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-505d3e20-41c6-44f3-a81c-6b2f7228a426 req-f40392d1-7877-4c31-b941-927f562b1ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9516b2a9-37fe-418b-8d86-2e6f37f83f72", "tag": "c9c48b6c-9661-4ed3-92da-fc33fecc1c02"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:24.874056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-505d3e20-41c6-44f3-a81c-6b2f7228a426 req-f40392d1-7877-4c31-b941-927f562b1ce8 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.874700 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-505d3e20-41c6-44f3-a81c-6b2f7228a426 req-f40392d1-7877-4c31-b941-927f562b1ce8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.875219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-505d3e20-41c6-44f3-a81c-6b2f7228a426 req-f40392d1-7877-4c31-b941-927f562b1ce8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.886385 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-505d3e20-41c6-44f3-a81c-6b2f7228a426 req-f40392d1-7877-4c31-b941-927f562b1ce8 service nova] Creating event network-changed:c9c48b6c-9661-4ed3-92da-fc33fecc1c02 for instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 on hv-cinder-82099 Sep 19 11:28:24.892250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-505d3e20-41c6-44f3-a81c-6b2f7228a426 req-f40392d1-7877-4c31-b941-927f562b1ce8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Sep 19 11:28:24.893100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 239/481] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:25.550236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:25.550861 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:25.557497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.557983 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.558424 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.559114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.559574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.560032 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.694379 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:25.702135 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5a2de688-9388-415b-b0c5-dc26e1684fb5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.155795 Sep 19 11:28:25.703239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 243/482] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:25 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:26.726350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:26.727059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:26.733885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.734305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.734748 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.735441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.735933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.736371 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.920953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:26.928812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-fdda544d-ac49-4316-a5cc-46965d9b4f00 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.206750 Sep 19 11:28:26.929373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 240/483] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:26 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:27.612001 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:27.612565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:27.618803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.619283 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.619721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.620422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.620880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.621306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.643678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-0c95193d-9128-4d4d-a79c-ff4f5e1c852d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036061 Sep 19 11:28:27.644208 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 244/484] 10.222.0.81 () {60 vars in 1289 bytes} [Mon Sep 19 11:28:27 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:28:27.951600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:27.952258 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:27.959456 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.959993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.960435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.961124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.961587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.962013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.088233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:28.096445 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-56b47175-37ac-4a59-bb49-a04ad93cf7c5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.148705 Sep 19 11:28:28.097016 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 241/485] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:27 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:29.118700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:29.119313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:29.125744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.126232 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.126671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.127355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.127842 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.128270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.259735 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:29.267372 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f680e464-eb7d-481e-b189-7a9dca978407 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.152564 Sep 19 11:28:29.267965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 245/486] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:29 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:29.479607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:29.480171 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:29.486547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.487033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.487476 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.488191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.488659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.489091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.511229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lazy-loading 'flavor' on Instance uuid 4bcee9ce-4870-41cc-bd56-b05958822d1f {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:29.530227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:29.707358 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1cca1005-f07f-4eac-b334-2c45e6a94b75 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/action" status: 202 len: 0 microversion: 2.20 time: 0.231500 Sep 19 11:28:29.708016 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 242/487] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 11:28:29 2022] POST /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:28:29.716222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:29.716848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:29.723278 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.723825 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.724268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.724969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.725429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.725860 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.852822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:29.860812 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:29.862271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:29.863489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-777cedfd-3636-4bc2-8f05-5fdd3e10a9f4 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.151294 Sep 19 11:28:29.864077 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 246/488] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:29 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:30.290978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:30.291708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:30.298514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.299002 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.299432 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.300136 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.300588 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.301007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.435713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:30.444083 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-72a217ef-04ae-4f6b-83f0-b0e6f94c015d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.157274 Sep 19 11:28:30.444659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 243/489] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:30 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:30.479492 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-49e1519e-33df-4c70-8a2e-277e958e50ce req-ce242e78-f861-458d-ba1c-9202f6d29ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9516b2a9-37fe-418b-8d86-2e6f37f83f72", "name": "network-vif-plugged", "status": "completed", "tag": "c9c48b6c-9661-4ed3-92da-fc33fecc1c02"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:30.490028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-49e1519e-33df-4c70-8a2e-277e958e50ce req-ce242e78-f861-458d-ba1c-9202f6d29ea5 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.490586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-49e1519e-33df-4c70-8a2e-277e958e50ce req-ce242e78-f861-458d-ba1c-9202f6d29ea5 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.491028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-49e1519e-33df-4c70-8a2e-277e958e50ce req-ce242e78-f861-458d-ba1c-9202f6d29ea5 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.502373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-49e1519e-33df-4c70-8a2e-277e958e50ce req-ce242e78-f861-458d-ba1c-9202f6d29ea5 service nova] Creating event network-vif-plugged:c9c48b6c-9661-4ed3-92da-fc33fecc1c02 for instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 on hv-cinder-82099 Sep 19 11:28:30.507449 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-49e1519e-33df-4c70-8a2e-277e958e50ce req-ce242e78-f861-458d-ba1c-9202f6d29ea5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Sep 19 11:28:30.508038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 247/490] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:30.889029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:30.889673 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:30.896605 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.897128 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.897570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.898262 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.898721 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.899155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:31.031201 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:31.039401 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:31.040970 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:31.042124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0e8dd778-5c44-4d16-a6eb-2c2449d99621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.157076 Sep 19 11:28:31.042691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 244/491] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:30 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:31.467080 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:31.467702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:31.473918 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:31.474400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:31.474840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:31.475525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:31.476015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:31.476439 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:31.604046 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:31.612265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8209c649-9d51-4f50-a32e-87f561ee093a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1367 microversion: 2.1 time: 0.149433 Sep 19 11:28:31.612831 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 248/492] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:31 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:32.066509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:32.067124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:32.069125 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:32.069790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:32.076281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.076766 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.077207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.077901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.078387 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.078823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.204717 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:32.214016 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:32.215481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:32.216671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-870aab16-4f84-44a8-9512-b6e689d3c0aa tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.154145 Sep 19 11:28:32.217426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 245/493] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:32 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:32.634466 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:32.635079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:32.637340 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:32.644997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.645492 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.645937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.646639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.647103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.647532 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.779230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:32.786895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-eb3b3c20-dd2a-44d0-b9ac-0ac0c9fe4916 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1556 microversion: 2.1 time: 0.156310 Sep 19 11:28:32.787463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 249/494] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:32 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:32.808671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:32.809170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:32.815645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.816162 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.816608 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.817297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.817757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.818188 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.895595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5edcd4c9-4a84-412d-96f7-519257793643 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090824 Sep 19 11:28:32.896231 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 246/495] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:28:32 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:33.244421 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:33.244944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:33.251589 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.252119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.252540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.253250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.253722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.254452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.257318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=100 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:33.493579 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.501680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.503073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.504264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-80733eae-6c69-4b5b-bc4f-343555f8bd80 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.263950 Sep 19 11:28:33.505045 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 250/496] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:33 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:34.149349 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-0b55b043-a7e2-47aa-a884-0cc82246e8bd req-120ac523-e8c4-45ed-a8d3-2506d040c26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9516b2a9-37fe-418b-8d86-2e6f37f83f72", "tag": "c9c48b6c-9661-4ed3-92da-fc33fecc1c02"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:34.159523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0b55b043-a7e2-47aa-a884-0cc82246e8bd req-120ac523-e8c4-45ed-a8d3-2506d040c26b service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.160109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0b55b043-a7e2-47aa-a884-0cc82246e8bd req-120ac523-e8c4-45ed-a8d3-2506d040c26b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.160656 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0b55b043-a7e2-47aa-a884-0cc82246e8bd req-120ac523-e8c4-45ed-a8d3-2506d040c26b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.172214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-0b55b043-a7e2-47aa-a884-0cc82246e8bd req-120ac523-e8c4-45ed-a8d3-2506d040c26b service nova] Creating event network-changed:c9c48b6c-9661-4ed3-92da-fc33fecc1c02 for instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 on hv-cinder-82099 Sep 19 11:28:34.177492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-0b55b043-a7e2-47aa-a884-0cc82246e8bd req-120ac523-e8c4-45ed-a8d3-2506d040c26b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032215 Sep 19 11:28:34.178197 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 247/497] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:34.529174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:34.529836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:34.536294 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.536804 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.537243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.537933 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.538399 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.538829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.667195 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:34.677129 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:34.678573 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:34.679727 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-fda8e881-8775-4f5e-9c7c-f67258a8c30d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.154566 Sep 19 11:28:34.680304 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 251/498] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:34 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:35.707576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:35.708311 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:35.714545 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:35.715031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:35.715474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:35.716190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:35.716653 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:35.717085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:35.847239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.855431 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.856928 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.858118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3eac1bdf-17a9-4df5-91e9-d5d5cec59575 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.156054 Sep 19 11:28:35.858677 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 248/499] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:35 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:36.883573 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:36.884218 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:36.891068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.891545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.892010 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.892716 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.893165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.893587 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.020687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.028805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.030332 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.031986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6fd2ba4c-4e81-44c3-9c43-95b17f95c12e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.152254 Sep 19 11:28:37.032551 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 252/500] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:36 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:38.057327 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:38.058044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:38.064777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.065250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.065682 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.066360 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.066812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.067232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.201249 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.210545 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.212185 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.213417 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-41ec25d4-e7f1-4ceb-bbcc-fb54cb0074c9 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.160259 Sep 19 11:28:38.213988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 249/501] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:38 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:39.239599 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:39.240174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:39.250672 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.251162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.251602 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.252315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.252777 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.253214 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.385460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.394428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.396654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.396786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1c44b5d7-5566-498a-9827-9293fe1361b7 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.161070 Sep 19 11:28:39.397623 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 253/502] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:39 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:40.423100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:40.423649 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:40.430036 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:40.430520 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:40.430950 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:40.431636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:40.432108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:40.432532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:40.563999 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:40.572384 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:40.573837 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:40.574997 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-751234b2-804c-49fb-98bb-503a0dc87534 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1743 microversion: 2.20 time: 0.156619 Sep 19 11:28:40.575557 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 250/503] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:40 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:41.602381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:41.603289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:41.605738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:41.611005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:41.611500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:41.611989 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:41.612693 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:41.613185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:41.613620 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:41.752523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.760491 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.761935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.763117 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8ce5cc86-050e-45e6-9b41-5fac8a56e621 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1743 microversion: 2.20 time: 0.165311 Sep 19 11:28:41.763682 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 254/504] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:41 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:42.789681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:42.794064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:42.803073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.803861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.804459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:42.805394 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.806008 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.806593 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:42.969399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:42.979281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:42.981104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:42.982524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f80e2bcc-2b17-4878-a544-5fd30b3dac2a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.196800 Sep 19 11:28:42.983184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 251/505] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:42 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:44.014479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:44.018533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:28:44.018955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Mon Sep 19 11:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f (ip 10.222.0.81) !!! Sep 19 11:28:44.019603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:44.028611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.029750 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.031950 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.033675 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.034771 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.035448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.060378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lazy-loading 'flavor' on Instance uuid 72e1113c-0919-481f-b283-3f513328bcda {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:44.155734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e3e06c8b-fa63-4528-8017-41ca8e9241cb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "POST /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda/action" status: 202 len: 0 microversion: 2.1 time: 0.145314 Sep 19 11:28:44.156805 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 252/506] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:28:44 2022] POST /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:28:44.165260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:44.166141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:44.172803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.173042 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:44.173291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.173654 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:44.173801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.174411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.174867 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.175292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.181966 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.182885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.183574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.184797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.185479 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.186384 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.415847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.427927 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-afd8cdfe-25df-485b-a975-6e2115110407 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.265829 Sep 19 11:28:44.428596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 253/507] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:44 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:44.430066 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.443814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.445657 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.446927 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7a0c0887-5721-417c-9fbf-bb182efc1c14 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.440832 Sep 19 11:28:44.447786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 255/508] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:44 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:44.595743 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-86284b0e-d7fd-4978-9071-47e78a6d7572 req-7af93844-4dea-46e5-89b8-6b7e63cdffc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "name": "network-vif-plugged", "status": "completed", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:44.608680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-86284b0e-d7fd-4978-9071-47e78a6d7572 req-7af93844-4dea-46e5-89b8-6b7e63cdffc8 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.609609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-86284b0e-d7fd-4978-9071-47e78a6d7572 req-7af93844-4dea-46e5-89b8-6b7e63cdffc8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.610993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-86284b0e-d7fd-4978-9071-47e78a6d7572 req-7af93844-4dea-46e5-89b8-6b7e63cdffc8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.628022 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-86284b0e-d7fd-4978-9071-47e78a6d7572 req-7af93844-4dea-46e5-89b8-6b7e63cdffc8 service nova] Creating event network-vif-plugged:34189864-79e6-4de2-a6e6-1f4a5a6f5640 for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f on hv-cinder-82099 Sep 19 11:28:44.634077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-86284b0e-d7fd-4978-9071-47e78a6d7572 req-7af93844-4dea-46e5-89b8-6b7e63cdffc8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042224 Sep 19 11:28:44.635182 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 254/509] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:45.452899 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:45.454546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:45.461562 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:45.462316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:45.462940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:45.463649 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:45.464264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:45.464702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:45.476646 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:45.478124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:45.486088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:45.486956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:45.487616 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:45.488640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:45.489314 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:45.489949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:45.665936 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.676698 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-096126a5-5ce3-4d01-9dea-13238f00f661 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.227588 Sep 19 11:28:45.677892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 256/510] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:45 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:45.695601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.704432 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.706030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.707225 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a10335cc-57a8-4a85-9c01-389cb162c154 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.237917 Sep 19 11:28:45.708081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 255/511] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:45 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:46.702841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:46.703570 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:46.723502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.724025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.724466 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.725170 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.725624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.726052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.736101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:46.736866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:46.744394 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.744881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.745322 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.746029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.746505 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.746938 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.987496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.001198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-44ba3d13-aa80-4c2c-822b-4185e4b6066d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.302106 Sep 19 11:28:47.002443 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 257/512] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:46 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:47.031234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.041102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.042842 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.044054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d7aad08a-6da2-4e49-b013-3d8d8be6cb00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.314802 Sep 19 11:28:47.044910 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 256/513] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:46 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:48.029872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:48.030424 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:48.036977 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.037495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.038000 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.038806 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.039273 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.039700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.072095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:48.072681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:48.090740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.091235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.091676 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.092406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.092863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.093287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.124094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:48.276956 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.285373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-11bf85f5-c7fe-457e-a984-6333ba2d2a6b tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.259609 Sep 19 11:28:48.286192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 258/514] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:48 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:48.312443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.321559 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.323246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.324527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-735aee53-78d8-49c3-8531-44919b1ded8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.256359 Sep 19 11:28:48.325448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 257/515] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:48 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:49.309356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:49.310803 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:49.318022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.318601 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.319114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.319913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.320575 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.320969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.351592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:49.352303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:49.360287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.361063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.361507 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.362202 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.362656 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.363081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.501717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.509620 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bee86b0d-ac5d-483b-8211-14572c214c31 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.204191 Sep 19 11:28:49.524203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 259/516] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:49 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:49.581056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.589524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.591196 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.592402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-08b3643e-2869-43b3-8066-758257fd7442 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.245061 Sep 19 11:28:49.608168 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 258/517] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:49 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:50.533308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:50.533889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:50.540612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.541107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.541549 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.542261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.542723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.543154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.620203 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:50.620823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:50.632378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.635145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.635604 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.636380 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.636849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.637287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.697573 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.706565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f0642005-6552-4f48-a217-e66da14f49cc tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.177506 Sep 19 11:28:50.707471 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 260/518] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:50 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:50.808436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.817256 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.819800 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.819987 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c1f9e5de-dbcc-4725-96dd-51cc17d49f9f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.204712 Sep 19 11:28:50.820785 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 259/519] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:50 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:51.749485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:51.750164 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:51.756635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.757122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.757559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.758251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.758711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.759140 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.845171 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:51.845777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:51.848075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:51.853595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.854086 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.854527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.855219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.855723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.856160 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.891591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:51.899274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-419fb834-2069-417a-9d42-3e2b9ce13c85 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.154039 Sep 19 11:28:51.899866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 261/520] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:51 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:51.994051 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:52.002663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:52.004186 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:52.005449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1c094e93-2011-4929-bf5e-b4f9e565aadc tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1738 microversion: 2.20 time: 0.164678 Sep 19 11:28:52.006005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 260/521] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:51 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:52.922187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:52.922895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:52.929230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:52.929724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:52.930166 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:52.930852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:52.931314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:52.931744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.066481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.074216 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e3f9a3e8-196c-4b81-b47c-8f5a363880c8 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.155962 Sep 19 11:28:53.074807 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 262/522] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:52 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:53.080795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:53.081487 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:53.086065 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:53.086584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:53.088314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:53.088875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:53.089593 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.090162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:53.090695 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:53.091132 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.092708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:53.093230 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:53.093686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.094424 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:53.094884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:53.095320 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.118069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-639655e1-b2f6-4173-908f-b41ba6cc3a70 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/ips" status: 200 len: 145 microversion: 2.1 time: 0.141679 Sep 19 11:28:53.118626 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 261/523] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:28:52 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/ips => generated 145 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:53.221362 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.229477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.230926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.232103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-79f7bcbf-9d57-4d61-b042-ac828e9961ea tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1720 microversion: 2.20 time: 0.156360 Sep 19 11:28:53.232668 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 263/524] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:53 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:54.098525 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:54.099100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:54.105519 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.106010 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.106473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.107159 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.107611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.242714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.250785 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4a03314b-4ded-46be-8d2d-584cc3039bd7 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.156798 Sep 19 11:28:54.253920 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 262/525] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:54 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:54.257940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:54.258742 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:54.265399 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.266669 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.267116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.267851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.268342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.268765 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.403968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.414145 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.415607 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.416804 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-41719ab9-4fa0-40b7-8f6e-05b46c468fbe tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1720 microversion: 2.20 time: 0.162889 Sep 19 11:28:54.431786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 264/526] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:54 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:54.468164 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54b9d3c1-8c25-4745-bc4f-880bd013b73f"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:54.470895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:54.477199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.477710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.478219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.479317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.479876 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.480381 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.742455 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-eb59c573-ac45-4262-b1df-266ec1d5034e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278206 Sep 19 11:28:54.748297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 263/527] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:28:54 2022] POST /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:55.279827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:55.280388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:55.287256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.287734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.288204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.288894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.289364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.289793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.427341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.435127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-39a3ea8f-a348-4850-8deb-8d43d6e6079a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.159354 Sep 19 11:28:55.435693 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 265/528] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:55 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:55.449456 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:55.450099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:55.456524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.457009 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.457454 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.458142 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.458600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.459031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.585163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.593427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.595466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.596661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-39820477-9aa2-46e4-b7c9-d9af14da9881 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1663 microversion: 2.20 time: 0.151977 Sep 19 11:28:55.597277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 264/529] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:55 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:55.622047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64f8bf33-1274-4b74-9a7f-3f63649175ef"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:55.624451 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:55.630374 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.630854 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.631289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.632002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.632457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.632884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.701075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=100 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:55.897279 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c68d674f-00a0-45ba-a313-c82648f5fee8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280295 Sep 19 11:28:55.897879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 266/530] 10.222.0.81 () {62 vars in 1364 bytes} [Mon Sep 19 11:28:55 2022] POST /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:28:56.022194 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:56.022701 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:56.029085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.029571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.030013 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.030705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.031683 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.032149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.263901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b99320e2-1ba1-47a2-92a7-0242fcdae52d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-volume_attachments/64f8bf33-1274-4b74-9a7f-3f63649175ef" status: 202 len: 0 microversion: 2.20 time: 0.245718 Sep 19 11:28:56.264485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 265/531] 10.222.0.81 () {60 vars in 1457 bytes} [Mon Sep 19 11:28:56 2022] DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-volume_attachments/64f8bf33-1274-4b74-9a7f-3f63649175ef => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:28:56.330204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:56.330808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:56.337881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.338373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.338812 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.339505 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.339992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.340425 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.369453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120458) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 11:28:56.434875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2966bef3-70e6-46ae-b185-b08846732a2e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "POST /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/action" status: 202 len: 0 microversion: 2.20 time: 0.109425 Sep 19 11:28:56.435474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 267/532] 10.222.0.81 () {62 vars in 1319 bytes} [Mon Sep 19 11:28:56 2022] POST /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:28:56.443656 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:56.444317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:56.450698 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.451264 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.453426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.453426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.453426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.454012 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.459077 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:56.459696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:56.465910 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.466400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.466846 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.467571 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.468065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.468501 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.672896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.681377 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.690963 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.692502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.693678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e1ce1364-d526-49d1-bf49-1ac425380029 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1671 microversion: 2.20 time: 0.253872 Sep 19 11:28:56.694409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 266/533] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:56 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:56.697269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f09a4c6a-fe9a-46b5-8884-ffae4891aa8d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.242000 Sep 19 11:28:56.697846 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 268/534] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:56 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:56.699298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-3566fe31-04d0-4091-859b-588192edd4c5 req-611d38f6-16d8-4ec2-8683-142d516e76de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "name": "network-vif-unplugged", "status": "completed", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:56.710349 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3566fe31-04d0-4091-859b-588192edd4c5 req-611d38f6-16d8-4ec2-8683-142d516e76de service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.710438 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3566fe31-04d0-4091-859b-588192edd4c5 req-611d38f6-16d8-4ec2-8683-142d516e76de service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.710993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3566fe31-04d0-4091-859b-588192edd4c5 req-611d38f6-16d8-4ec2-8683-142d516e76de service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.736214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.compute.server_external_events [req-3566fe31-04d0-4091-859b-588192edd4c5 req-611d38f6-16d8-4ec2-8683-142d516e76de service nova] Unable to find a host for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f. Dropping event network-vif-unplugged {{(pid=120459) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 11:28:56.737150 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-3566fe31-04d0-4091-859b-588192edd4c5 req-611d38f6-16d8-4ec2-8683-142d516e76de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041634 Sep 19 11:28:56.738007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 267/535] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 11:28:57.721940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:57.722676 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:57.725237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:57.725861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:57.729289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.729782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.730226 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.730925 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.731385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.731838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.733156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.733656 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.734107 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.735365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.735854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.736294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.939869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.949509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.949677 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.951234 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.954296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8a62976b-8568-42e0-bf7b-80905bd09830 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1673 microversion: 2.20 time: 0.236908 Sep 19 11:28:57.956181 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 269/536] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:57 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1673 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:57.960163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9e02917a-9351-42a8-86cf-5a15cc5e7375 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1509 microversion: 2.1 time: 0.238846 Sep 19 11:28:57.960806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 268/537] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:57 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:57.983939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:57.984761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:57.992365 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.993352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.993971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.995100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.995852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.997049 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.027523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120458) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 11:28:58.095533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-42face1c-1244-467b-bfe5-53fc14b9c642 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "POST /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda/action" status: 202 len: 0 microversion: 2.1 time: 0.115644 Sep 19 11:28:58.096236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 270/538] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:28:57 2022] POST /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:28:58.104324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:58.104929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:58.110928 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.111408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.112048 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.112737 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.113205 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.113621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.292991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:58.303551 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-817e2ea4-91e5-432a-b1fe-5d492653beb4 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1517 microversion: 2.1 time: 0.202961 Sep 19 11:28:58.307958 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 269/539] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:58 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:58.981735 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:58.982465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:58.988405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.988896 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.989341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.990044 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.990518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.990948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:59.138336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.147560 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.148732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.150236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-59ada5a5-8d22-4fad-8908-8f4375bdf222 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.172715 Sep 19 11:28:59.150948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 271/540] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:58 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:59.328459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:59.329278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:59.335543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:59.336308 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:59.336912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:59.337775 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:59.338394 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:59.338978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:59.489303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.498613 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b6cccda9-9b5c-400c-88e4-f471e5c3604c tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.173794 Sep 19 11:28:59.499477 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 270/541] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:59 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:00.175166 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:00.175870 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:00.182507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.183097 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.183595 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.184412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.184938 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.185427 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.328882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.337411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.338876 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.340070 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f6effb78-e7de-451e-a679-ed20ce95d325 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.169473 Sep 19 11:29:00.340847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 272/542] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:00 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:00.522530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:00.523176 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:00.529935 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.534418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.535089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.535887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.536619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.536827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.541524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:00.621723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-fb60c6c5-38a5-4344-9d2d-a8e10d482b6d req-5d792658-1b52-4912-bd88-a9009af98d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "name": "network-vif-unplugged", "status": "completed", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:00.633985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-fb60c6c5-38a5-4344-9d2d-a8e10d482b6d req-5d792658-1b52-4912-bd88-a9009af98d49 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.634712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-fb60c6c5-38a5-4344-9d2d-a8e10d482b6d req-5d792658-1b52-4912-bd88-a9009af98d49 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.635437 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-fb60c6c5-38a5-4344-9d2d-a8e10d482b6d req-5d792658-1b52-4912-bd88-a9009af98d49 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.674386 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.compute.server_external_events [req-fb60c6c5-38a5-4344-9d2d-a8e10d482b6d req-5d792658-1b52-4912-bd88-a9009af98d49 service nova] Unable to find a host for instance 72e1113c-0919-481f-b283-3f513328bcda. Dropping event network-vif-unplugged {{(pid=120458) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 11:29:00.675722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-fb60c6c5-38a5-4344-9d2d-a8e10d482b6d req-5d792658-1b52-4912-bd88-a9009af98d49 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057414 Sep 19 11:29:00.676433 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 273/543] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 11:29:00.738898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.748685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ad8edcae-4ca8-48f2-8f92-4052966eea23 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.229947 Sep 19 11:29:00.749270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 271/544] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:00 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:01.365238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:01.365923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:01.372798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.373564 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.374177 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.375581 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.376477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.377073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.520635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.530134 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.531791 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.533204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ad6ab9ed-b4fc-4b56-97d2-f96e769c1303 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.172281 Sep 19 11:29:01.533768 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 274/545] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:01 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:01.774397 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:01.776025 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:01.783134 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.783745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.784373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.785149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.785799 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.786233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.926486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.934962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-75c1c494-3159-4ede-94f9-8904fd701038 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.164535 Sep 19 11:29:01.935659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 272/546] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:01 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:02.559314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:02.560882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:02.570208 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.571072 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.571740 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.572717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.573398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.574038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.779740 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.788949 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.790740 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.792159 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-fe440920-6806-48a8-a58a-3ca46685510f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.237585 Sep 19 11:29:02.810309 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 275/547] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:02 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:02.958641 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:02.959322 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:02.966003 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.966491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.966932 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.967641 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.968142 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.969113 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:03.103889 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:03.114618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1f02ff87-8798-42ec-9404-a08c216698eb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.159780 Sep 19 11:29:03.115569 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 273/548] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:02 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:03.818598 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:03.819204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:03.825671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:03.826159 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:03.826592 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:03.827289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:03.827841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:03.828267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:03.984658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:03.998258 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.001776 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.003309 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-440ff172-4884-4bdb-aa83-20750b6b617e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.188397 Sep 19 11:29:04.008613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 276/549] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:03 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:04.141212 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:04.141883 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:04.148631 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:04.149211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:04.149661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:04.150369 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:04.150972 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:04.151593 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:04.293166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.302075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e2c4fd72-7f9f-4801-92b6-457b35c8d9ad tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.165395 Sep 19 11:29:04.313371 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 274/550] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:04 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:05.030069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:05.030780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:05.037553 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.038038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.038477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.039172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.039626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.040267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.195047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.204217 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.205662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.206822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b44ca029-3e23-4876-8c7c-f26a5f125d43 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.181135 Sep 19 11:29:05.219816 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 277/551] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:05 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:05.327992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:05.328835 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:05.335233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.335725 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.336206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.336905 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.337368 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.337803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.508598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.516705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bf572a6f-46a9-442d-a554-6e17d745286d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.192709 Sep 19 11:29:05.517306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 275/552] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:05 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:06.232609 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:06.233222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:06.239937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.240352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.240787 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.241491 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.241935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.242364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.392968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.402595 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.404078 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.405316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d46a981b-12ac-472f-a600-03985bd5ea16 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.176600 Sep 19 11:29:06.406864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 278/553] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:06 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:06.539992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:06.540613 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:06.547465 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.547992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.548435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.549125 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.549576 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.549999 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.914433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.922190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-84fff260-5782-4a5f-a8b2-d153169b2a37 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.386135 Sep 19 11:29:06.922744 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 276/554] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:06 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:07.430409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:07.431017 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:07.437982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.438469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.438902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.439582 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.440066 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.440489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.455646 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:07.570952 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.579711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.581194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.582355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d1e29a21-2dfa-40b1-b4a3-07ff1622013d tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.155811 Sep 19 11:29:07.582914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 279/555] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:07 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:07.944816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:07.945439 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:07.951813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.952353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.953624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.954323 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.954788 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.955219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.088602 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:08.096324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c6741b7d-b617-4c55-948b-87079af71a0e tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.155406 Sep 19 11:29:08.096899 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 277/556] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:07 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:08.606706 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:08.607316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:08.614648 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.615174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.615614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.616352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.616837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.617268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.756364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:08.764829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:08.766283 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:08.767445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3511dea5-ae0a-4763-b824-e9b6ab357175 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.164694 Sep 19 11:29:08.768040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 280/557] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:08 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:09.119486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:09.120087 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:09.127021 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.127513 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.128147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.129081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.129562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.130005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.269108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.276899 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c5bc9f77-09e7-46c4-b95f-99da7b727b91 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1519 microversion: 2.1 time: 0.161965 Sep 19 11:29:09.277834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 278/558] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:09 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:09.770694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:09.772885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:09.779270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.779755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.780223 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.781398 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.781854 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.782277 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.794609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:09.795239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:09.802567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.803063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.803508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.804261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.804722 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.805331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.813600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-332e6fbe-927c-4793-90e9-1ae8e70c9eea tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Sep 19 11:29:09.814188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 281/559] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:29:09 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:09.824864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:09.825354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:09.831909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.832399 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.832838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.833530 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.833987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.834417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.864201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-349c399b-6dbe-4541-ba18-5275700a03fe tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/54b9d3c1-8c25-4745-bc4f-880bd013b73f" status: 200 len: 194 microversion: 2.1 time: 0.043025 Sep 19 11:29:09.864797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 282/560] 10.222.0.81 () {58 vars in 1413 bytes} [Mon Sep 19 11:29:09 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/54b9d3c1-8c25-4745-bc4f-880bd013b73f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:09.973484 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.981643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.983351 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.984600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4212525e-9698-42ba-b636-237bc59ef88c tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.194999 Sep 19 11:29:09.996603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 279/561] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:09 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:10.300930 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:10.301574 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:10.307486 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.308020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.308466 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.309161 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.309620 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.310050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.534190 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:10.542283 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ab7aa429-7fe9-456f-8dcf-5fb96f6361c5 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.245190 Sep 19 11:29:10.543110 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 283/562] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:10 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:11.009922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:11.010534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:11.017521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.018015 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.018467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.019152 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.019614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.020077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.149519 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.158051 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.159508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.160709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9f601ede-615c-4a34-8e45-5caf9a8eddcd tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.154712 Sep 19 11:29:11.161346 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 280/563] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:11 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:11.222353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc989752-2908-4c80-bcb0-d6aebf393245"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:11.224834 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:11.231316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.231835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.232282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.232974 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.233482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.234461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.466099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ea80abae-0c5e-4b35-8f4c-942be7cf0ca1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "POST /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247819 Sep 19 11:29:11.466729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 284/564] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:29:11 2022] POST /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:11.566360 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:11.566974 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:11.573039 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.573530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.573973 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.574660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.575119 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.575551 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.726469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.743757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4a7b09f2-c14c-4c39-8ada-8be777fc8309 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.181222 Sep 19 11:29:11.743757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 281/565] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:11 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:12.187774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:12.188468 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:12.190868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:12.197339 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.197837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.198282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.198986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.199444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.199932 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.331074 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:12.339100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:12.340577 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:12.341725 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6fd4fe91-d390-4c2d-9466-c29c75681173 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.158980 Sep 19 11:29:12.342282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 285/566] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:12 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:12.768230 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:12.768846 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:12.775161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.775679 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.776188 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.776879 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.777342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.777769 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.872029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-9a68fa22-fcb1-4dd2-b5cc-7f65e1205f07 req-c211ee85-b0dc-4bd2-abc5-db6b751d92e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "name": "network-vif-plugged", "status": "completed", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:12.881938 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-9a68fa22-fcb1-4dd2-b5cc-7f65e1205f07 req-c211ee85-b0dc-4bd2-abc5-db6b751d92e0 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.882426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-9a68fa22-fcb1-4dd2-b5cc-7f65e1205f07 req-c211ee85-b0dc-4bd2-abc5-db6b751d92e0 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.882859 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-9a68fa22-fcb1-4dd2-b5cc-7f65e1205f07 req-c211ee85-b0dc-4bd2-abc5-db6b751d92e0 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.894872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-9a68fa22-fcb1-4dd2-b5cc-7f65e1205f07 req-c211ee85-b0dc-4bd2-abc5-db6b751d92e0 service nova] Creating event network-vif-plugged:34189864-79e6-4de2-a6e6-1f4a5a6f5640 for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f on hv-cinder-82099 Sep 19 11:29:12.905698 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-9a68fa22-fcb1-4dd2-b5cc-7f65e1205f07 req-c211ee85-b0dc-4bd2-abc5-db6b751d92e0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098267 Sep 19 11:29:12.906304 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 286/567] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:12.924093 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:12.932298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9d696425-1e6a-47b6-9566-f25c0ca93dd0 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.167853 Sep 19 11:29:12.932873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 282/568] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:12 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:13.368435 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:13.369132 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:13.375823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.376309 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.376747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.377436 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.377890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.378314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.521514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.529483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.530996 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.532163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-42072206-99c3-40ee-8aa2-624e00cc9898 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.168524 Sep 19 11:29:13.532716 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 287/569] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:13 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:13.955664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:13.956358 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:13.962818 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.963307 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.963755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.964478 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.964942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.965406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.097336 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.104967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e9ebac80-9caf-4c40-a81a-353b4b27055a tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.153570 Sep 19 11:29:14.105526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 283/570] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:13 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:14.558087 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:14.558892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:14.566217 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.566802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.567375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.568177 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.568699 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.569302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.705883 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.715189 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.716675 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.718606 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c1918067-c8b1-43d2-a606-801f14cc5d08 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1729 microversion: 2.20 time: 0.164956 Sep 19 11:29:14.719330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 288/571] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:14 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:15.127784 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:15.128552 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:15.135040 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.135560 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.136042 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.136737 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.137194 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.137622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.273587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.281297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a9da75c2-98c0-42cc-afd3-8f8a4eed0425 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.157434 Sep 19 11:29:15.281868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 284/572] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:15 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:15.745082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:15.745691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:15.752460 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.752948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.753383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.754064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.754524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.754948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.882729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.891349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.892822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.893971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c85ce6c6-15d3-47af-b733-149802280f8f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1716 microversion: 2.20 time: 0.152959 Sep 19 11:29:15.894534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 289/573] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:15 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:16.304579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:16.305190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:16.312189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.312669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.313102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.313786 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.314237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.314658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.446009 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:16.454741 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6150bc87-6665-4f47-be1a-30bbdd3460bb tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.153986 Sep 19 11:29:16.455322 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 285/574] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:16 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:17.477428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:17.478046 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:17.484569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.485057 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.485497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.486188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.486647 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.487082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.570362 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:17.570954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:17.577816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.578652 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.579166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.579976 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.580514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.580953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.604833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f7c27596-d460-4820-ad0f-f9ffda99f8ab tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/ips" status: 200 len: 148 microversion: 2.1 time: 0.038861 Sep 19 11:29:17.605413 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 286/575] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:29:17 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:17.628963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:17.636892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7a1b514b-1573-46df-ab14-3805312391f9 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.163241 Sep 19 11:29:17.637484 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 290/576] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:17 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:18.661024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:18.661637 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:18.668078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.668574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.669012 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.669712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.670175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.671166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.810351 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:18.818348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2506faa2-5873-4cbb-9d0b-a8a58d8b2cdd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.161211 Sep 19 11:29:18.818922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 287/577] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:18 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:18.970788 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63473bcd-38df-4a67-85da-99113712801e"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:18.973303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:18.979822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.980297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.980729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.982538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.982538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.982538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.059180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.061727 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.068638 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.069199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.069643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.070444 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.070903 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.071335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.075504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:19.105988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8d4376bc-ad7a-48a4-930d-2e6242c72774 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050637 Sep 19 11:29:19.106568 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 288/578] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:29:19 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:19.247031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.247925 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.257752 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.258361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.259068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.259905 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.260428 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.261087 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.264910 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2710e173-de6f-4cc0-aad6-c5f04b866e2d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298417 Sep 19 11:29:19.265824 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 291/579] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:29:18 2022] POST /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:19.304125 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-618be8c4-c0f4-45c7-966d-65ea4cabc753 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/54b9d3c1-8c25-4745-bc4f-880bd013b73f" status: 200 len: 194 microversion: 2.1 time: 0.062922 Sep 19 11:29:19.304805 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 289/580] 10.222.0.81 () {58 vars in 1413 bytes} [Mon Sep 19 11:29:19 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/54b9d3c1-8c25-4745-bc4f-880bd013b73f => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:19.319150 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.320238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.331645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.331645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.332294 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.333260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.334108 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.334545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.426019 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lazy-loading 'services' on Instance uuid b41ac543-a9ec-414f-a8e8-4d7e39da3faa {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:19.510642 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a14705ab-f742-43d0-b322-8e84dd5c8473 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/54b9d3c1-8c25-4745-bc4f-880bd013b73f" status: 202 len: 0 microversion: 2.1 time: 0.197256 Sep 19 11:29:19.511156 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 292/581] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:29:19 2022] DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/54b9d3c1-8c25-4745-bc4f-880bd013b73f => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:19.845294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.845916 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.852341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.852832 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.853276 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.853969 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.854432 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.854863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.989014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:19.996806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c20e3d47-2dbc-4cb5-aa5a-826b5da23fa1 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.155970 Sep 19 11:29:19.997372 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 290/582] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:19 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:20.747942 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-b8f26a9b-f149-4a10-9c2b-b4889318149d req-c97212c8-6e6c-4d62-b30e-80b7b17165e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "name": "network-vif-plugged", "status": "completed", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:20.758354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-b8f26a9b-f149-4a10-9c2b-b4889318149d req-c97212c8-6e6c-4d62-b30e-80b7b17165e0 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.758838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-b8f26a9b-f149-4a10-9c2b-b4889318149d req-c97212c8-6e6c-4d62-b30e-80b7b17165e0 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.759268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-b8f26a9b-f149-4a10-9c2b-b4889318149d req-c97212c8-6e6c-4d62-b30e-80b7b17165e0 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.770054 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-b8f26a9b-f149-4a10-9c2b-b4889318149d req-c97212c8-6e6c-4d62-b30e-80b7b17165e0 service nova] Creating event network-vif-plugged:d337a699-9f06-4ec9-8cec-da0fca00d0ab for instance 72e1113c-0919-481f-b283-3f513328bcda on hv-cinder-82099 Sep 19 11:29:20.774723 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-b8f26a9b-f149-4a10-9c2b-b4889318149d req-c97212c8-6e6c-4d62-b30e-80b7b17165e0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Sep 19 11:29:20.775313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 293/583] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:21.020383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:21.020768 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:21.027179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.027673 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.028148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.028846 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.029304 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.030228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.167184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:21.174940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3501e284-5466-4080-850e-7215c6461c70 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1575 microversion: 2.1 time: 0.158818 Sep 19 11:29:21.175502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 291/584] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:21 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:22.199406 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:22.200127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:22.207147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.207624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.208088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.208766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.209220 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.209643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.213550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:22.344374 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:22.351913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-304be08d-c8e3-4018-b93d-303634f2fddd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1562 microversion: 2.1 time: 0.157145 Sep 19 11:29:22.352467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 294/585] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:22 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:26.832486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f33d2f43-0a0d-4ce1-af12-42ec5c34d6c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: .version_select at 0x7ff52162f8b0>, body: {"keypair": {"name": "tempest-keypair-1833719367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHKn3vAQx1/fv2EN5Luajxv9gQOWCc/6OcoTcF8v+Jwdnuo1cIprBUU7M3kB6+wD+3OrV14W08D/cEbmy4qN5qcfUsqvOKYBP2ruzPZBH448H1CL2HMLFWBMVnOZnn31Q=="}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:26.838287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=64 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:26.850296 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-f33d2f43-0a0d-4ce1-af12-42ec5c34d6c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:29:26.854065 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-f33d2f43-0a0d-4ce1-af12-42ec5c34d6c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:29:26.874959 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f33d2f43-0a0d-4ce1-af12-42ec5c34d6c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046256 Sep 19 11:29:26.875540 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 292/586] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:29:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:26.992324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:26.992841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:26.999755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.000288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.000728 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.001499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.001941 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.002483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.033526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ebbf45ee-8bd7-473a-8d39-c4c572d56d87 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/bc989752-2908-4c80-bcb0-d6aebf393245" status: 200 len: 194 microversion: 2.1 time: 0.045112 Sep 19 11:29:27.034559 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 295/587] 10.222.0.81 () {58 vars in 1413 bytes} [Mon Sep 19 11:29:26 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/bc989752-2908-4c80-bcb0-d6aebf393245 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:27.045708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:27.046247 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:27.055089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.055241 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.055622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.056358 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.056809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.057251 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.139544 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lazy-loading 'services' on Instance uuid b41ac543-a9ec-414f-a8e8-4d7e39da3faa {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:27.214162 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3d989115-381b-4328-aba5-121e602efb40 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/bc989752-2908-4c80-bcb0-d6aebf393245" status: 202 len: 0 microversion: 2.1 time: 0.173259 Sep 19 11:29:27.214765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 293/588] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:29:27 2022] DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments/bc989752-2908-4c80-bcb0-d6aebf393245 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:29:28.357995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1302242191", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bd047f8-e757-4211-9ab1-9e25ad2c412a"}], "security_groups": [{"name": "tempest-securitygroup--1456734349"}], "key_name": "tempest-keypair-1833719367", "user_data": "}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:28.400673 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:28.403220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:28.413979 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.414486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.414931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.415640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.416132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.416569 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.448233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-db31cfe7-4443-4605-af08-229e8222870b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051916 Sep 19 11:29:28.448804 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 294/589] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:29:28 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 11:29:28.473863 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] validate_networks() for [('4bd047f8-e757-4211-9ab1-9e25ad2c412a', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:29:28.569208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:28.571378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:28.577309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.578063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.578496 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.579183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.579634 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.580101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.609825 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-749f0f10-73f0-4643-bea7-c9d787669f13 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044556 Sep 19 11:29:28.610404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 295/590] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:29:28 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 11:29:28.674808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:28.675508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:28.681943 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.682473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.682949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.683669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.684160 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.684670 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.711126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:29:28.786433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ad642234-b7dd-4f7e-9b31-3c62ac10bcf8 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 204 len: 0 microversion: 2.1 time: 0.115930 Sep 19 11:29:28.787316 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 296/591] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:29:28 2022] DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 11:29:28.796806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:28.797584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:28.803932 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.804502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.805016 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.805803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.806340 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.806862 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.955960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:29:28.956418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:29:28.956889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:29:28.957291 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:29:28.957697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:29:28.966483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.967649 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.968142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.968866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.969346 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.969767 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.986640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:28.987942 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:29:28.992040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:29:28.994449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4f0c4d46-eb20-4de7-84be-9a446999ba7d tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1671 microversion: 2.1 time: 0.202590 Sep 19 11:29:28.995131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 297/592] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:28 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1671 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:29.005372 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:29:29.005372 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:29:29.054751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-56044804-2057-4ac2-b5c6-57e483fd0875 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.700879 Sep 19 11:29:29.055390 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 296/593] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:29:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:29:29.066504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-58e309e5-8c68-4d9b-9b23-1a864d79ba0b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:29.067129 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-58e309e5-8c68-4d9b-9b23-1a864d79ba0b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:29.120431 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-58e309e5-8c68-4d9b-9b23-1a864d79ba0b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:29.127398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-58e309e5-8c68-4d9b-9b23-1a864d79ba0b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1242 microversion: 2.1 time: 0.064716 Sep 19 11:29:29.128132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 298/594] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:29 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:30.019241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:30.019798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:30.029095 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.029583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.030330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.031025 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.031476 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.031937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.149848 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:30.150503 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:30.157104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.157586 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.158033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.158731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.159193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.159625 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.165514 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:30.173757 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-0c81dbaf-2d24-4883-b743-b0b87bc40ed4 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1671 microversion: 2.1 time: 0.158724 Sep 19 11:29:30.174328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 297/595] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:30 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:30.221435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:30.228957 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e096d58a-4a81-458d-8671-22f36757fe25 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1246 microversion: 2.1 time: 0.083009 Sep 19 11:29:30.229526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 299/596] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:30 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:30.346703 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:30.347114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:30.353042 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.353523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.353954 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.354630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.355079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.355496 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.381019 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:29:30.468472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-fffb9241-3be5-4df2-b4e5-3ded9173e250 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 204 len: 0 microversion: 2.1 time: 0.125068 Sep 19 11:29:30.469254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 298/597] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:29:30 2022] DELETE /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:29:30.477566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:30.478190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:30.484884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.485379 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.485822 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.486513 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.486977 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.487409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.614369 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:30.622267 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-de5bf8fc-6854-429c-813a-01f151dd91bb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1577 microversion: 2.1 time: 0.148589 Sep 19 11:29:30.622833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 300/598] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:30 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:31.198222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:31.198959 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:31.206337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.206780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.207209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.207934 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.208396 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.208827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.251608 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:31.252259 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:31.258625 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.259117 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.259558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.260290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.260752 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.261185 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.331331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:31.339066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-eac44fb2-41ac-4c87-a648-04dbcb92167e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1238 microversion: 2.1 time: 0.091717 Sep 19 11:29:31.339639 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 301/599] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:31 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:31.361143 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:31.368922 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5da78bdb-8d0c-4102-a7cc-b59a7f697fba tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1671 microversion: 2.1 time: 0.174985 Sep 19 11:29:31.369488 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 299/600] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:31 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:31.645414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:31.646036 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:31.652178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.652672 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.653114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.653822 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.654315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.654750 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.826931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:31.834920 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-944a24de-e3d5-4dfd-ac60-44decc782e38 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1577 microversion: 2.1 time: 0.193388 Sep 19 11:29:31.835485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 302/601] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:31 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:32.361303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:32.361988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:32.368378 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:32.368871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:32.369315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:32.370012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:32.370473 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:32.370905 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:32.393029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:32.393650 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:32.400300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:32.400800 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:32.401246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:32.401961 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:32.402433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:32.402858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:32.482163 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:32.489895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cb0e581c-4231-43fe-9073-231bad713d04 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1294 microversion: 2.1 time: 0.133055 Sep 19 11:29:32.490478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 300/602] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:32 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:32.858158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:32.858826 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:32.865103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:32.865602 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:32.866153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:32.866865 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:32.867319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:32.867742 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:33.067666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:33.077370 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-df88f913-9433-4c4c-a510-2eeacd71756e tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1671 microversion: 2.1 time: 0.688323 Sep 19 11:29:33.078742 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 303/603] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:32 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1671 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:33.487493 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:33.496924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c0e65000-6947-484b-9d79-a459d4ef466f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1577 microversion: 2.1 time: 0.642585 Sep 19 11:29:33.497994 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 301/604] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:32 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1577 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:33.518855 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:33.519665 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:33.526289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:33.526854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:33.527403 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:33.528224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:33.528774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:33.529780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:33.553480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:33.660635 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:33.668748 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5e7dbefd-264a-4b7a-814b-579db3ef3849 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1300 microversion: 2.1 time: 0.153759 Sep 19 11:29:33.669650 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 304/605] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:33 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:34.102215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:34.103205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:34.109849 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.110338 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.110773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.111471 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.113375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.113813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.232922 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:34.241543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-19deb965-df03-430e-b0aa-5b3c22f9ef2b tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1603 microversion: 2.1 time: 0.143656 Sep 19 11:29:34.242116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 302/606] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:34 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1603 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:34.521408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:34.522725 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:34.535103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.538924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.539580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.540761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.545461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.546107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.581605 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-0227b96e-f054-4e7c-951a-35926c2f6039 req-4b3074ee-5e0c-4930-8f65-a928187eb952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b41ac543-a9ec-414f-a8e8-4d7e39da3faa", "name": "network-vif-deleted", "tag": "b7a27a1f-b11e-49b5-8ad6-452d21e318e9"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:34.599217 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0227b96e-f054-4e7c-951a-35926c2f6039 req-4b3074ee-5e0c-4930-8f65-a928187eb952 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.600234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0227b96e-f054-4e7c-951a-35926c2f6039 req-4b3074ee-5e0c-4930-8f65-a928187eb952 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.603734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-0227b96e-f054-4e7c-951a-35926c2f6039 req-4b3074ee-5e0c-4930-8f65-a928187eb952 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.631814 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-0227b96e-f054-4e7c-951a-35926c2f6039 req-4b3074ee-5e0c-4930-8f65-a928187eb952 service nova] Creating event network-vif-deleted:b7a27a1f-b11e-49b5-8ad6-452d21e318e9 for instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa on hv-cinder-82099 Sep 19 11:29:34.655667 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-0227b96e-f054-4e7c-951a-35926c2f6039 req-4b3074ee-5e0c-4930-8f65-a928187eb952 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197425 Sep 19 11:29:34.660097 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 305/607] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:34.682602 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:34.695162 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:34.697334 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:34.718381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-31e8169a-b764-4c80-adcd-a316c3ea3bb8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1509 microversion: 2.1 time: 0.200985 Sep 19 11:29:34.721031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 303/608] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:34 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:34.738601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.739116 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.739568 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.741167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.741640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.742148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.070223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:35.078993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-73ba8a0e-feb2-4921-93f5-8d6df5dec4cf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.390288 Sep 19 11:29:35.079721 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 306/609] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:34 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:35.267060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:35.268033 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:35.275270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.276095 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.276709 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.277597 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.278221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.279489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.345732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.346576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.347561 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.348267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lazy-loading 'fault' on Instance uuid b41ac543-a9ec-414f-a8e8-4d7e39da3faa {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:35.438070 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a4a7aca62974db38138a38de399139f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a952d8324548d7a8e80f72449ea5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:35.450629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d2a1cf84-1052-4784-95b3-77a656b8d7a1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 200 len: 1325 microversion: 2.1 time: 0.188281 Sep 19 11:29:35.460238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 304/610] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:35 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:35.744371 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:35.745889 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:35.753715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.754470 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.755094 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.756555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.760714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.761381 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.800030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.802286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.802872 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.803410 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lazy-loading 'fault' on Instance uuid ae508c34-2fb3-4348-b3a0-df59607692b5 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:36.053452 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:36.062078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-cdfce164-682d-478e-a9cf-83011d2546a2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 200 len: 1229 microversion: 2.1 time: 0.321721 Sep 19 11:29:36.062664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 307/611] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:35 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 1229 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:36.104331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:36.105299 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:36.113581 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.114198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.114885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.115873 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.116617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.117284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.332801 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:36.341320 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2b977df8-d4ce-4efc-8132-67b1e2057969 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.240996 Sep 19 11:29:36.341891 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 305/612] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:36 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:36.481473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:36.482725 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:36.488835 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.489316 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.489748 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.490429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.490884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.491307 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.505782 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] HTTP exception thrown: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Request method failure captured: Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa HTTP/1.1 Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE6UvhJJygs09S9byDFLXqmFboyqbJZDKVGIGtZajwG7Tz2xqog9cV6Smvn-dqacnKHtFtJHvwzH--ojDcmCNezCb60cR_9nNSwmSW8hw5Y-FD6RQLaj_ZJbjgMq1_npgCkhtJi00Qnd1-hrxyX9QtPFHpmCG34tUphsGmUNKXuVnA Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:29:36.507441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8a952d8324548d7a8e80f72449ea5e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}] Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 9a4a7aca62974db38138a38de399139f Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:36.508922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'b41ac543-a9ec-414f-a8e8-4d7e39da3faa'} Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:36.509723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:36.510947 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:36.512187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Returning 404 to user: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:36.512187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6ccb0c5a-d533-455d-8578-524af0da94c9 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 404 len: 111 microversion: 2.1 time: 0.031567 Sep 19 11:29:36.512187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 308/613] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:36 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:36.518016 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03170593-1b60-4b2a-b649-e66b687a0bd1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '.version_select at 0x7ff5215ceee0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:36.538014 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-03170593-1b60-4b2a-b649-e66b687a0bd1 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-689379936" status: 202 len: 0 microversion: 2.1 time: 0.023799 Sep 19 11:29:36.539002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 306/614] 10.222.0.81 () {58 vars in 1218 bytes} [Mon Sep 19 11:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-689379936 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:36.696294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae508c34-2fb3-4348-b3a0-df59607692b5", "name": "network-vif-deleted", "tag": "b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5"}, {"name": "network-changed", "server_uuid": "ea8afe02-fe11-4fab-a7b0-3113b9d6cccd", "tag": "68a2fa93-058e-42f3-b595-547f56e82dda"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:36.707038 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.707525 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.708141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.721245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] Creating event network-vif-deleted:b03ddb0e-3c29-4aa7-aaeb-1b30c55256d5 for instance ae508c34-2fb3-4348-b3a0-df59607692b5 on hv-cinder-82099 Sep 19 11:29:36.721776 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] Creating event network-changed:68a2fa93-058e-42f3-b595-547f56e82dda for instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd on hv-cinder-82099 Sep 19 11:29:36.727972 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-990f3c5d-3ce5-4ce3-873f-f04f81ef1c5a req-e0f803b2-6400-48c5-a101-98817fe00a3c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035362 Sep 19 11:29:36.728557 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 309/615] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:37.085154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:37.086012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:37.092234 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.092728 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.093171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.093871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.094334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.094769 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.109515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] HTTP exception thrown: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Request method failure captured: Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 HTTP/1.1 Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFHxDhl6Sncnup-nAVMm87xtYXrbAxprj9Iq60CXr2zkjM6iKJfyFJwDvgGeJlKIEV484IixBE66SIQBc8IJnhtEyHoQaI-HiQnhqRDO6R4_t8fGTFLfEuXbQTC6wpJzQc10suS06Z8rHU49IUKCZS1pRrkEx9SH5yGu6ORQ-SpJomE Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:37.111186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8351993a1ab94f82bc238a23b2d542d3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}] Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-TestVolumeBootPattern-983423422 Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 7f546dc2d8b24eeea8c6eac968c56806 Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:29:37.112867 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'ae508c34-2fb3-4348-b3a0-df59607692b5'} Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:37.124069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:29:37.125678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:37.127805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Returning 404 to user: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:37.127805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e374ece3-6191-4109-b383-65a88837de87 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 404 len: 111 microversion: 2.1 time: 0.031486 Sep 19 11:29:37.127805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 307/616] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:37 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:37.215414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-865250853", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-847173717", "security_groups": [{"name": "tempest-secgroup-smoke-1916601463"}], "block_device_mapping_v2": [{"uuid": "c1c20e77-8151-4ccf-9403-9ac1c4024033", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fb35c99b-23b9-4b32-a307-2150c63e0c0a"}]}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:37.333508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] validate_networks() for [('fb35c99b-23b9-4b32-a307-2150c63e0c0a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:29:37.367524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:37.368499 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:37.376427 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.376912 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.377519 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.378442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.379049 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.379666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.584825 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:37.592682 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9f40f1d6-627b-416b-96c5-328806ef596e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.229770 Sep 19 11:29:37.593441 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 308/617] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:37 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:37.830235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:29:37.830660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:29:37.831132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:29:37.831540 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:29:37.832000 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:29:37.840660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.841089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.841526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.842253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.842704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.843132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.859812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:29:37.863699 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for user 7f546dc2d8b24eeea8c6eac968c56806 and project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:29:37.919351 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:29:37.922211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1c20e77-8151-4ccf-9403-9ac1c4024033',volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:29:38.065255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-398a8448-4ce5-44e2-b396-8bc86659ee22 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.854573 Sep 19 11:29:38.065903 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 310/618] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:29:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:29:38.077225 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e85d9077-b28e-4d15-9049-b219066df302 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:38.078198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e85d9077-b28e-4d15-9049-b219066df302 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:38.161184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e85d9077-b28e-4d15-9049-b219066df302 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:38.167981 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e85d9077-b28e-4d15-9049-b219066df302 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1093 microversion: 2.1 time: 0.094613 Sep 19 11:29:38.168550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 309/619] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:38 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:38.617444 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:38.617994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:38.624884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:38.625375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:38.625817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:38.626514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:38.627083 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:38.627707 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:38.765579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:38.773267 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4c2d5960-c7e2-4949-9f34-355c267c6517 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.160422 Sep 19 11:29:38.773832 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 311/620] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:38 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:39.192958 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:39.193566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:39.196158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:39.202089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.202855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.203331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.203998 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.204627 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.205062 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.313958 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:39.322210 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-fe90307c-a275-4abf-99a8-f40507bc1305 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1199 microversion: 2.1 time: 0.132910 Sep 19 11:29:39.338178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 310/621] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:39 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1199 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:39.569081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:39.569580 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:39.575900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.576434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.576888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.577956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.578526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.578953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.593693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] HTTP exception thrown: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Request method failure captured: Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa HTTP/1.1 Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE6UvhJJygs09S9byDFLXqmFboyqbJZDKVGIGtZajwG7Tz2xqog9cV6Smvn-dqacnKHtFtJHvwzH--ojDcmCNezCb60cR_9nNSwmSW8hw5Y-FD6RQLaj_ZJbjgMq1_npgCkhtJi00Qnd1-hrxyX9QtPFHpmCG34tUphsGmUNKXuVnA Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:29:39.595353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8a952d8324548d7a8e80f72449ea5e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}] Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 9a4a7aca62974db38138a38de399139f Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.596897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'b41ac543-a9ec-414f-a8e8-4d7e39da3faa'} Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:39.597773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.599359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.601154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Returning 404 to user: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:39.601154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-60c6cda2-0e97-49eb-90fd-a81f0a70b4cc tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 404 len: 111 microversion: 2.1 time: 0.031508 Sep 19 11:29:39.601154 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 312/622] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:29:39 2022] DELETE /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:39.606422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:39.607715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: b41ac543-a9ec-414f-a8e8-4d7e39da3faa] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:39.614323 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.614819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.615251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.616028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.616487 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.616909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.630269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] HTTP exception thrown: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Request method failure captured: Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa HTTP/1.1 Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE6UvhJJygs09S9byDFLXqmFboyqbJZDKVGIGtZajwG7Tz2xqog9cV6Smvn-dqacnKHtFtJHvwzH--ojDcmCNezCb60cR_9nNSwmSW8hw5Y-FD6RQLaj_ZJbjgMq1_npgCkhtJi00Qnd1-hrxyX9QtPFHpmCG34tUphsGmUNKXuVnA Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:39.631815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8a952d8324548d7a8e80f72449ea5e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}] Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 9a4a7aca62974db38138a38de399139f Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.633409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'b41ac543-a9ec-414f-a8e8-4d7e39da3faa'} Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:39.634192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. Sep 19 11:29:39.635370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:39.637857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Returning 404 to user: Instance b41ac543-a9ec-414f-a8e8-4d7e39da3faa could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:39.637857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-03066b74-2100-45e0-9135-b2bcaf658a03 tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa" status: 404 len: 111 microversion: 2.1 time: 0.030640 Sep 19 11:29:39.637857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 311/623] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:39 2022] GET /compute/v2.1/servers/b41ac543-a9ec-414f-a8e8-4d7e39da3faa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:39.798281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:39.799814 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:39.806310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.806955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.807611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.808413 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.809044 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.809636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.995951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:40.004667 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-54ade876-d813-4ecf-83b5-6ccbe971c63c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.211576 Sep 19 11:29:40.005278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 313/624] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:39 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:40.345755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.346498 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.352788 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.353281 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.353730 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.354457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.354927 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.355352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.565487 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:40.568148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:40.576782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f2e64de9-a077-4a84-8722-844e3185b1f2 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.235278 Sep 19 11:29:40.577755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 312/625] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:40 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:40.782250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.782762 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.789228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.789726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.790355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.791066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.791530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.792170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.807895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] HTTP exception thrown: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Request method failure captured: Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 HTTP/1.1 Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE6UvhJJygs09S9byDFLXqmFboyqbJZDKVGIGtZajwG7Tz2xqog9cV6Smvn-dqacnKHtFtJHvwzH--ojDcmCNezCb60cR_9nNSwmSW8hw5Y-FD6RQLaj_ZJbjgMq1_npgCkhtJi00Qnd1-hrxyX9QtPFHpmCG34tUphsGmUNKXuVnA Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:29:40.810156 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8a952d8324548d7a8e80f72449ea5e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}] Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 9a4a7aca62974db38138a38de399139f Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.811527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1'} Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:40.812427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.813584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.815621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Returning 404 to user: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:40.816657 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a5db82e0-5881-46e4-91b0-ff47c17578cf tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 404 len: 111 microversion: 2.1 time: 0.038834 Sep 19 11:29:40.817704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 314/626] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:29:40 2022] DELETE /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:40.827008 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.827975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] [instance: fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.835096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.835600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.836084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.837021 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.837689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.838133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.854640 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] HTTP exception thrown: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Request method failure captured: Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 HTTP/1.1 Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE6UvhJJygs09S9byDFLXqmFboyqbJZDKVGIGtZajwG7Tz2xqog9cV6Smvn-dqacnKHtFtJHvwzH--ojDcmCNezCb60cR_9nNSwmSW8hw5Y-FD6RQLaj_ZJbjgMq1_npgCkhtJi00Qnd1-hrxyX9QtPFHpmCG34tUphsGmUNKXuVnA Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:40.856231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e8a952d8324548d7a8e80f72449ea5e6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e8a952d8324548d7a8e80f72449ea5e6"}]}] Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: e8a952d8324548d7a8e80f72449ea5e6 Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeTestJSON-465769820 Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 9a4a7aca62974db38138a38de399139f Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeTestJSON-465769820-project Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.857566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1'} Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:40.858284 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. Sep 19 11:29:40.859485 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:40.861658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] Returning 404 to user: Instance fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:40.861658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cf7cc375-18fd-4605-a491-63f90d4bfdbb tempest-AttachVolumeTestJSON-465769820 tempest-AttachVolumeTestJSON-465769820-project] 10.222.0.81 "GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1" status: 404 len: 111 microversion: 2.1 time: 0.036169 Sep 19 11:29:40.861658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 313/627] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:40 2022] GET /compute/v2.1/servers/fbcb63b9-9aca-4b0e-8d59-97f57b35c8b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:40.923918 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-d8afa36b-afc1-4370-9286-d14295d70c53 req-cc042db6-b744-4130-9b39-5f28d3d50a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4043326f-606a-4ce6-81d9-95bbd73358d0", "tag": "33c62641-505f-4f2e-b389-5020e568a62a"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:40.933960 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d8afa36b-afc1-4370-9286-d14295d70c53 req-cc042db6-b744-4130-9b39-5f28d3d50a65 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.935323 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d8afa36b-afc1-4370-9286-d14295d70c53 req-cc042db6-b744-4130-9b39-5f28d3d50a65 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.936041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d8afa36b-afc1-4370-9286-d14295d70c53 req-cc042db6-b744-4130-9b39-5f28d3d50a65 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.948153 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-d8afa36b-afc1-4370-9286-d14295d70c53 req-cc042db6-b744-4130-9b39-5f28d3d50a65 service nova] Creating event network-changed:33c62641-505f-4f2e-b389-5020e568a62a for instance 4043326f-606a-4ce6-81d9-95bbd73358d0 on hv-cinder-82099 Sep 19 11:29:40.954160 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-d8afa36b-afc1-4370-9286-d14295d70c53 req-cc042db6-b744-4130-9b39-5f28d3d50a65 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033819 Sep 19 11:29:40.955336 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 315/628] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:41.026869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:41.027631 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:41.033711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.034273 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.034770 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.035525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.036075 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.036562 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.237056 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:41.245508 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1d8a88a7-cfe9-4c3d-a9b1-4fc923439507 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.222379 Sep 19 11:29:41.260998 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 314/629] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:41 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:41.602248 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:41.602958 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:41.609692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.610219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.610669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.611359 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.611835 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.612266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.840352 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:41.852029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-58de3f49-1f9d-495e-9984-4bb288ec9a2a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.253732 Sep 19 11:29:41.853795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 316/630] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:41 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:42.270261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:42.270876 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:42.273262 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:42.279212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:42.279711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:42.280182 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:42.280887 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:42.281347 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:42.281776 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:42.432385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:42.441538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-926496f7-beae-4198-84f1-6d6d06abc143 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.175061 Sep 19 11:29:42.443805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 315/631] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:42 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:42.877653 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:42.878530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:42.885758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:42.886583 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:42.887121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:42.888486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:42.889182 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:42.889725 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.032603 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.040757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f5258d0b-0d9a-4144-8ba7-31fab804aadc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.167259 Sep 19 11:29:43.041331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 317/632] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:42 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:43.084607 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-87908ce1-d060-4ed3-af48-b851026b386e req-f0e6d699-740f-4a10-b1a9-0c02ed1f39d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8afe02-fe11-4fab-a7b0-3113b9d6cccd", "name": "network-vif-plugged", "status": "completed", "tag": "68a2fa93-058e-42f3-b595-547f56e82dda"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:43.095828 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-87908ce1-d060-4ed3-af48-b851026b386e req-f0e6d699-740f-4a10-b1a9-0c02ed1f39d1 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.096510 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-87908ce1-d060-4ed3-af48-b851026b386e req-f0e6d699-740f-4a10-b1a9-0c02ed1f39d1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.101105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-87908ce1-d060-4ed3-af48-b851026b386e req-f0e6d699-740f-4a10-b1a9-0c02ed1f39d1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.116126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-87908ce1-d060-4ed3-af48-b851026b386e req-f0e6d699-740f-4a10-b1a9-0c02ed1f39d1 service nova] Creating event network-vif-plugged:68a2fa93-058e-42f3-b595-547f56e82dda for instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd on hv-cinder-82099 Sep 19 11:29:43.121206 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-87908ce1-d060-4ed3-af48-b851026b386e req-f0e6d699-740f-4a10-b1a9-0c02ed1f39d1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040235 Sep 19 11:29:43.121892 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 316/633] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:43.465118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:43.465739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:43.478223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.478732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.479350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.480268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.480868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.481438 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.664267 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.675873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a3086f59-cb24-4c59-9dd8-6f5c9a4a9046 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.214711 Sep 19 11:29:43.676454 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 318/634] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:43 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:44.065322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:44.065744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:44.072341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.072835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.073281 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.073982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.074442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.074871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.513764 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:44.521633 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-38a694ab-3b74-4db0-a5ba-4ff3c6c0be05 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.461478 Sep 19 11:29:44.522215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 317/635] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:44 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:44.699057 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:44.699681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:44.707091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.707590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.708077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.708776 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.709239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.709667 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.852413 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:44.860584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5bc7307e-d179-4a8a-97c8-0fc28fe6e980 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1368 microversion: 2.1 time: 0.165296 Sep 19 11:29:44.861237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 319/636] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:44 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:45.353600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-29ec9421-c3b8-4f29-b7bd-0a4de9b6c275 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Action: 'create', calling method: .version_select at 0x7ff5215430d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2001908205"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:45.547413 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:45.549518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:45.556324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.558715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.558715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.558715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.559319 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.559798 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.674991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-29ec9421-c3b8-4f29-b7bd-0a4de9b6c275 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.432541 Sep 19 11:29:45.676100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 318/637] 10.222.0.81 () {60 vars in 1155 bytes} [Mon Sep 19 11:29:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 434 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 11:29:45.688843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5a3d50e4-071c-42fa-b155-064b4bb0b01f tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff5215771f0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:45.712900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:45.721204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f24a9e82-b173-453d-bb7c-812d832df6f0 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.178388 Sep 19 11:29:45.721968 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 320/638] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:45 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:45.741944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5a3d50e4-071c-42fa-b155-064b4bb0b01f tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 200 len: 345 microversion: 2.1 time: 0.057039 Sep 19 11:29:45.742522 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 319/639] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:45 2022] GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:45.882780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:45.883399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:45.889945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.890431 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.890872 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.891558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.892122 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.892553 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.022021 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:46.030326 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9f6b2327-890a-4649-8303-04ca7ffeff94 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1558 microversion: 2.1 time: 0.151440 Sep 19 11:29:46.030887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 321/640] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:45 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:46.052084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:46.052592 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:46.059147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.059700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.060173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.060873 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.061333 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.061763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.136404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8b2e0f66-bc5c-4bbc-9547-bd2e56baeb50 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088137 Sep 19 11:29:46.137023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 320/641] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:46.744460 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:46.745081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:46.755790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.755790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.755790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.756956 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1d0a9a2f-9a71-4a0b-9373-48f51d5ae427 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff5215438b0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:46.767102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.767732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.768215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.808099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1d0a9a2f-9a71-4a0b-9373-48f51d5ae427 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 200 len: 346 microversion: 2.1 time: 0.055769 Sep 19 11:29:46.808676 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 321/642] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:46.822315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cf80a4db-0a9d-485f-96f3-a0f99d31563d tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Action: 'create', calling method: .version_select at 0x7ff5215da160>, body: {"snapshot": {"volume_id": "632ac5b6-956d-4e7f-9fd7-6f7ea121911e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-639481166"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:46.986050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cf80a4db-0a9d-485f-96f3-a0f99d31563d tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.167743 Sep 19 11:29:46.986636 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 322/643] 10.222.0.81 () {60 vars in 1162 bytes} [Mon Sep 19 11:29:46 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:46.997223 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c5f980ad-6142-40f0-bba7-f05130f7c50c tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff521532b80>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:47.006886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:47.016777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9935a103-27cb-480f-80c4-e5aae88e400d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.276077 Sep 19 11:29:47.032418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 322/644] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:47.035969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c5f980ad-6142-40f0-bba7-f05130f7c50c tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 200 len: 286 microversion: 2.1 time: 0.042343 Sep 19 11:29:47.036764 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 323/645] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:47.048478 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-20d9a232-aecf-4728-a0df-444916b21f10 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff5215b39d0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:47.080271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-20d9a232-aecf-4728-a0df-444916b21f10 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035930 Sep 19 11:29:47.080982 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 323/646] 10.222.0.81 () {58 vars in 1140 bytes} [Mon Sep 19 11:29:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:47.092246 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-26970226-4cb4-400e-a58c-5d41c2332bf9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff521532af0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:47.122206 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-26970226-4cb4-400e-a58c-5d41c2332bf9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 200 len: 286 microversion: 2.1 time: 0.034198 Sep 19 11:29:47.122920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 324/647] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:47 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:47.186989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-3fdf8417-973f-4d66-96e3-cdffc973411a req-5d257038-8b62-4afd-a260-346a3bfe0a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8afe02-fe11-4fab-a7b0-3113b9d6cccd", "tag": "68a2fa93-058e-42f3-b595-547f56e82dda"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:47.197000 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3fdf8417-973f-4d66-96e3-cdffc973411a req-5d257038-8b62-4afd-a260-346a3bfe0a60 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.197490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3fdf8417-973f-4d66-96e3-cdffc973411a req-5d257038-8b62-4afd-a260-346a3bfe0a60 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.197931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3fdf8417-973f-4d66-96e3-cdffc973411a req-5d257038-8b62-4afd-a260-346a3bfe0a60 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.208394 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-3fdf8417-973f-4d66-96e3-cdffc973411a req-5d257038-8b62-4afd-a260-346a3bfe0a60 service nova] Creating event network-changed:68a2fa93-058e-42f3-b595-547f56e82dda for instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd on hv-cinder-82099 Sep 19 11:29:47.213218 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-3fdf8417-973f-4d66-96e3-cdffc973411a req-5d257038-8b62-4afd-a260-346a3bfe0a60 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029886 Sep 19 11:29:47.213809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 324/648] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:48.040833 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:48.041454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:48.048431 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.048930 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.049387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.050111 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.050785 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.051222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.132169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:48.133198 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=12 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:48.137728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9d96d834-aab3-4ce6-a868-22c45627d93b tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff52155b8b0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:48.166494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=8 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:48.168136 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9d96d834-aab3-4ce6-a868-22c45627d93b tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 200 len: 286 microversion: 2.1 time: 0.037287 Sep 19 11:29:48.169465 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 325/649] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:48 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:48.197928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:48.206979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-54a6eae6-2720-4587-9d3b-0c1bf4e34da3 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.170444 Sep 19 11:29:48.207848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 325/650] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:48 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:49.181774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-33adc5c9-2283-44d3-ad37-443b28ff62ed tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff521955670>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:49.213458 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-33adc5c9-2283-44d3-ad37-443b28ff62ed tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 200 len: 286 microversion: 2.1 time: 0.036032 Sep 19 11:29:49.214126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 326/651] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:49 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:49.229924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:49.230527 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:49.237052 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.237534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.237964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.238643 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.239096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.239517 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.368226 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:49.376333 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2599e083-b191-432c-8a9d-4e8b068fa572 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.150239 Sep 19 11:29:49.376893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 326/652] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:49 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:50.226430 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-508ea9bd-8f6d-4ac0-9dc1-c2184237b1df tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff5215b3790>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:50.258124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-508ea9bd-8f6d-4ac0-9dc1-c2184237b1df tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 200 len: 287 microversion: 2.1 time: 0.036064 Sep 19 11:29:50.258698 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 327/653] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:50 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:50.270539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-743bf5ab-bc10-41f6-b94a-ba1a6aa6c983 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff5214f0ee0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:50.333124 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-743bf5ab-bc10-41f6-b94a-ba1a6aa6c983 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 202 len: 0 microversion: 2.1 time: 0.066163 Sep 19 11:29:50.336984 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 327/654] 10.222.0.81 () {58 vars in 1254 bytes} [Mon Sep 19 11:29:50 2022] DELETE /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:50.342330 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-042f0e6f-79f9-4c29-9924-28b47644e116 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff521534670>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:50.372892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-042f0e6f-79f9-4c29-9924-28b47644e116 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 200 len: 286 microversion: 2.1 time: 0.033654 Sep 19 11:29:50.373752 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 328/655] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:50 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:50.399871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:50.400495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:50.406685 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.407201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.407932 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.408634 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.409093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.409526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.652311 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:50.660754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b605936b-419b-4469-be0d-194c1453601e tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.264886 Sep 19 11:29:50.661326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 328/656] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:50 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:51.139250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-38dde4a2-c030-41f5-9052-30f49d9d59bb req-88cfae06-ea06-4833-8f2b-8700665568de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4043326f-606a-4ce6-81d9-95bbd73358d0", "name": "network-vif-plugged", "status": "completed", "tag": "33c62641-505f-4f2e-b389-5020e568a62a"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:51.144068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:51.150714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-38dde4a2-c030-41f5-9052-30f49d9d59bb req-88cfae06-ea06-4833-8f2b-8700665568de service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.151208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-38dde4a2-c030-41f5-9052-30f49d9d59bb req-88cfae06-ea06-4833-8f2b-8700665568de service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.151645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-38dde4a2-c030-41f5-9052-30f49d9d59bb req-88cfae06-ea06-4833-8f2b-8700665568de service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.164720 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-38dde4a2-c030-41f5-9052-30f49d9d59bb req-88cfae06-ea06-4833-8f2b-8700665568de service nova] Creating event network-vif-plugged:33c62641-505f-4f2e-b389-5020e568a62a for instance 4043326f-606a-4ce6-81d9-95bbd73358d0 on hv-cinder-82099 Sep 19 11:29:51.169880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-38dde4a2-c030-41f5-9052-30f49d9d59bb req-88cfae06-ea06-4833-8f2b-8700665568de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034768 Sep 19 11:29:51.170466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 329/657] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:51.387200 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9397f484-cdf9-47f2-bd5f-636bba65c6b9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff52155c5e0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.418165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-9397f484-cdf9-47f2-bd5f-636bba65c6b9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] HTTP exception thrown: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9397f484-cdf9-47f2-bd5f-636bba65c6b9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Request method failure captured: Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 HTTP/1.1 Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFKpxErGvIZCUjyHDCwHdSbjznlSBfbpaL1oePzAgrHqmK9O2dGH39InUYPMRkXLS0KzfKFKVOjdpFHFz3G9192szV_55pQVfWeOPlF73dL1FuvGWIqJcOUQG5I9RBAXaAmpuXCuY2oyx7-sgGWEU_Y35oRitMaQaq7jPiy2Rhwjuik Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:51.420518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5edd41152b674bb5bb3c24b16fdc6934", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}] Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 77b5cd137d7a443b81e928477350c42b Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '41966eeb-7082-47f0-ac6b-da2d8c6a5534'} Sep 19 11:29:51.422173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. (HTTP 404) (Request-ID: req-f9190656-0bd4-4f03-9da4-6f890e13f56f) Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.423821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:51.425031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 11:29:51.426926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9397f484-cdf9-47f2-bd5f-636bba65c6b9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Returning 404 to user: Snapshot 41966eeb-7082-47f0-ac6b-da2d8c6a5534 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:51.428722 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9397f484-cdf9-47f2-bd5f-636bba65c6b9 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534" status: 404 len: 111 microversion: 2.1 time: 0.039999 Sep 19 11:29:51.429689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 329/658] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:29:51 2022] GET /compute/v2.1/os-snapshots/41966eeb-7082-47f0-ac6b-da2d8c6a5534 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:51.431803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e05ad25d-fb71-49bc-ae73-85302efed237 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff521534af0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.495498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e05ad25d-fb71-49bc-ae73-85302efed237 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 202 len: 0 microversion: 2.1 time: 0.068438 Sep 19 11:29:51.496124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 330/659] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:29:51 2022] DELETE /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:51.504969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-51203bb4-cd16-47bc-9817-9840ed8cc7f4 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff521543ee0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.554214 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-51203bb4-cd16-47bc-9817-9840ed8cc7f4 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 200 len: 345 microversion: 2.1 time: 0.052917 Sep 19 11:29:51.560093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 330/660] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:51 2022] GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:51.683282 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.685143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:51.691284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.691900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.692421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.693264 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.693823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.694253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.840180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:51.848006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7ea00f30-27d1-4c6e-b6af-3b411c32e4ad tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1265 microversion: 2.1 time: 0.168575 Sep 19 11:29:51.848571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 331/661] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:51 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:52.569852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-48aedadf-c888-4624-b512-aeeadcdcd1f0 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff52155cb80>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.599415 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-48aedadf-c888-4624-b512-aeeadcdcd1f0 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] HTTP exception thrown: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-48aedadf-c888-4624-b512-aeeadcdcd1f0 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Request method failure captured: Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e HTTP/1.1 Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFKpxErGvIZCUjyHDCwHdSbjznlSBfbpaL1oePzAgrHqmK9O2dGH39InUYPMRkXLS0KzfKFKVOjdpFHFz3G9192szV_55pQVfWeOPlF73dL1FuvGWIqJcOUQG5I9RBAXaAmpuXCuY2oyx7-sgGWEU_Y35oRitMaQaq7jPiy2Rhwjuik Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:52.601454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5edd41152b674bb5bb3c24b16fdc6934", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}] Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 77b5cd137d7a443b81e928477350c42b Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '632ac5b6-956d-4e7f-9fd7-6f7ea121911e'} Sep 19 11:29:52.602975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. (HTTP 404) (Request-ID: req-f38908cf-7a00-44e4-a492-7e2001d12754) Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.604175 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:52.605502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:29:52.606653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-48aedadf-c888-4624-b512-aeeadcdcd1f0 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Returning 404 to user: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-48aedadf-c888-4624-b512-aeeadcdcd1f0 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 404 len: 109 microversion: 2.1 time: 0.037457 Sep 19 11:29:52.608404 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 331/662] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:52 2022] GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:52.614302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bda563a3-4f76-4d29-8511-7508dc094ba3 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff52168fee0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.649701 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-bda563a3-4f76-4d29-8511-7508dc094ba3 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] HTTP exception thrown: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bda563a3-4f76-4d29-8511-7508dc094ba3 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Request method failure captured: Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e HTTP/1.1 Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFKpxErGvIZCUjyHDCwHdSbjznlSBfbpaL1oePzAgrHqmK9O2dGH39InUYPMRkXLS0KzfKFKVOjdpFHFz3G9192szV_55pQVfWeOPlF73dL1FuvGWIqJcOUQG5I9RBAXaAmpuXCuY2oyx7-sgGWEU_Y35oRitMaQaq7jPiy2Rhwjuik Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:29:52.652005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5edd41152b674bb5bb3c24b16fdc6934", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}] Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 77b5cd137d7a443b81e928477350c42b Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '632ac5b6-956d-4e7f-9fd7-6f7ea121911e'} Sep 19 11:29:52.653666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. (HTTP 404) (Request-ID: req-3d2a87de-1ec4-4a99-b4af-da0f28d48378) Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.655114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:29:52.656547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:29:52.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bda563a3-4f76-4d29-8511-7508dc094ba3 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Returning 404 to user: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:52.661080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bda563a3-4f76-4d29-8511-7508dc094ba3 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 404 len: 109 microversion: 2.1 time: 0.043012 Sep 19 11:29:52.662463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-046dfcb4-25d4-4572-a43c-3190384a86a6 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Calling method '.version_select at 0x7ff5215431f0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.666702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 332/663] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:29:52 2022] DELETE /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:52.691351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-046dfcb4-25d4-4572-a43c-3190384a86a6 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] HTTP exception thrown: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-046dfcb4-25d4-4572-a43c-3190384a86a6 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Request method failure captured: Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e HTTP/1.1 Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFKpxErGvIZCUjyHDCwHdSbjznlSBfbpaL1oePzAgrHqmK9O2dGH39InUYPMRkXLS0KzfKFKVOjdpFHFz3G9192szV_55pQVfWeOPlF73dL1FuvGWIqJcOUQG5I9RBAXaAmpuXCuY2oyx7-sgGWEU_Y35oRitMaQaq7jPiy2Rhwjuik Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:52.693348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5edd41152b674bb5bb3c24b16fdc6934", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5edd41152b674bb5bb3c24b16fdc6934"}]}] Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 5edd41152b674bb5bb3c24b16fdc6934 Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1257953169 Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 77b5cd137d7a443b81e928477350c42b Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1257953169-project Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '632ac5b6-956d-4e7f-9fd7-6f7ea121911e'} Sep 19 11:29:52.694823 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. (HTTP 404) (Request-ID: req-7fda23f4-16f0-42cb-ac06-e9c3628da839) Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.695591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:52.696960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:29:52.698352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-046dfcb4-25d4-4572-a43c-3190384a86a6 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] Returning 404 to user: Volume 632ac5b6-956d-4e7f-9fd7-6f7ea121911e could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-046dfcb4-25d4-4572-a43c-3190384a86a6 tempest-VolumesSnapshotsTestJSON-1257953169 tempest-VolumesSnapshotsTestJSON-1257953169-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e" status: 404 len: 109 microversion: 2.1 time: 0.036097 Sep 19 11:29:52.699656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 332/664] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:52 2022] GET /compute/v2.1/os-volumes/632ac5b6-956d-4e7f-9fd7-6f7ea121911e => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:52.870335 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.871705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:52.878227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:52.878723 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:52.879172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:52.880033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:52.880685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:52.881261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.019027 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:53.022514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=100 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:53.027963 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ba2d2ecd-ef4e-4bb2-960e-814236d90434 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1452 microversion: 2.1 time: 0.161451 Sep 19 11:29:53.028527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 333/665] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:52 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:53.056538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:53.057159 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:53.065213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:53.065872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:53.066428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.067343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:53.067832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:53.068271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.272533 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:53.280662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b7c1cd2c-681f-4d27-9564-55f46468eeba tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1452 microversion: 2.1 time: 0.229537 Sep 19 11:29:53.281266 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 333/666] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:53 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1452 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:54.243745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-619cfa26-d2a7-4ead-8125-92b60c61a2c3 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Action: 'create', calling method: .version_select at 0x7ff5216488b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1999143511", "metadata": {"Type": "work"}}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:54.541102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-619cfa26-d2a7-4ead-8125-92b60c61a2c3 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.417614 Sep 19 11:29:54.541739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 334/667] 10.222.0.81 () {60 vars in 1156 bytes} [Mon Sep 19 11:29:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 11:29:54.554486 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7cda47cd-ff18-40c8-9aa5-1ddd0aaa2d66 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Calling method '.version_select at 0x7ff5216061f0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:54.608840 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7cda47cd-ff18-40c8-9aa5-1ddd0aaa2d66 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96" status: 200 len: 353 microversion: 2.1 time: 0.058106 Sep 19 11:29:54.609677 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 334/668] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:54 2022] GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:54.718357 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:54.720469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:54.727265 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.727781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.728216 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.728921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.729398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.729822 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.758505 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0e243b49-fcfc-45a9-b791-87ccf29bbe3f tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044194 Sep 19 11:29:54.759069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 335/669] 10.222.0.81 () {60 vars in 1343 bytes} [Mon Sep 19 11:29:54 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:54.825459 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:54.825966 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:54.832604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.833101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.833547 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.834257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.834721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.835162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.862592 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:29:54.945270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e0aec0ed-7bab-411e-ad4e-d3fafc57f08a tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 204 len: 0 microversion: 2.20 time: 0.123284 Sep 19 11:29:54.945843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 335/670] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 11:29:54 2022] DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 11:29:54.955953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:54.956567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:54.963337 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.963885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.964496 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.965208 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.965664 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.966088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:55.103303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:55.113421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:55.126928 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:55.128174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ec12011d-3b69-4b11-bd85-9cca52175b00 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.177000 Sep 19 11:29:55.128739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 336/671] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:54 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:55.228475 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-f8a35ab7-b5cb-41be-976d-96e2721b98a3 req-65f7ae8e-c3ce-4353-a118-c88df4bef807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4043326f-606a-4ce6-81d9-95bbd73358d0", "tag": "33c62641-505f-4f2e-b389-5020e568a62a"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:55.238613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-f8a35ab7-b5cb-41be-976d-96e2721b98a3 req-65f7ae8e-c3ce-4353-a118-c88df4bef807 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:55.239188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-f8a35ab7-b5cb-41be-976d-96e2721b98a3 req-65f7ae8e-c3ce-4353-a118-c88df4bef807 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:55.239515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-f8a35ab7-b5cb-41be-976d-96e2721b98a3 req-65f7ae8e-c3ce-4353-a118-c88df4bef807 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:55.251431 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-f8a35ab7-b5cb-41be-976d-96e2721b98a3 req-65f7ae8e-c3ce-4353-a118-c88df4bef807 service nova] Creating event network-changed:33c62641-505f-4f2e-b389-5020e568a62a for instance 4043326f-606a-4ce6-81d9-95bbd73358d0 on hv-cinder-82099 Sep 19 11:29:55.256337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-f8a35ab7-b5cb-41be-976d-96e2721b98a3 req-65f7ae8e-c3ce-4353-a118-c88df4bef807 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091643 Sep 19 11:29:55.256919 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 336/672] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:55.623469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-699fd906-0051-41ad-88e4-8bd7a881dc7c tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Calling method '.version_select at 0x7ff5215a70d0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:55.679478 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-699fd906-0051-41ad-88e4-8bd7a881dc7c tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96" status: 200 len: 354 microversion: 2.1 time: 0.059716 Sep 19 11:29:55.680172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 337/673] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:55 2022] GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:55.695022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4102ffd9-22ae-49a5-963b-95dc4a317f4b tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Calling method '.version_select at 0x7ff5214f0dc0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:55.743692 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4102ffd9-22ae-49a5-963b-95dc4a317f4b tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96" status: 200 len: 354 microversion: 2.1 time: 0.053410 Sep 19 11:29:55.744490 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 337/674] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:55 2022] GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:55.761699 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c69a6767-06d0-4f4e-963a-bb316dc144ba tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Calling method '.version_select at 0x7ff5215dc3a0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:55.820912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c69a6767-06d0-4f4e-963a-bb316dc144ba tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96" status: 202 len: 0 microversion: 2.1 time: 0.062911 Sep 19 11:29:55.821511 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 338/675] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:29:55 2022] DELETE /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:55.830633 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dbea7dee-bb37-4b88-afa5-03c8e33f6f16 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Calling method '.version_select at 0x7ff521606160>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:55.880040 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-dbea7dee-bb37-4b88-afa5-03c8e33f6f16 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96" status: 200 len: 353 microversion: 2.1 time: 0.053935 Sep 19 11:29:55.880615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 338/676] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:55 2022] GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:56.152795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:56.153402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:56.161922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:56.162678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:56.163118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:56.163842 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:56.164299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:56.164727 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:56.376812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.388114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.390441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.391779 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bb0da368-ea0e-4d71-84ee-a13ebf75ba04 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1722 microversion: 2.20 time: 0.242919 Sep 19 11:29:56.392350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 339/677] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:56 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:56.894848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1be0871e-010d-4f7a-882e-d225382eac26 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Calling method '.version_select at 0x7ff521642e50>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:56.923881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-1be0871e-010d-4f7a-882e-d225382eac26 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] HTTP exception thrown: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1be0871e-010d-4f7a-882e-d225382eac26 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Request method failure captured: Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 HTTP/1.1 Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFKyBCOOQnBdjaszQS2ECUNUTT1FPo-czq-4vrg9Ay0W4W75s4VxJamx-8VIkQlT1-SvsvQ77X9CKk8LGbuyQXfKbrypD_yDCa2gm2JKjgbk88g28iqemmlJ9qKER3Beqsr-EJB7zuRilN3KesuFW27jRk2YCvRb1LEgUH7HPMal0w0 Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 41c250ab9f55450a83feab4c7a1bccdc Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesGetTestJSON-1551776721 Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:56.926064 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_41c250ab9f55450a83feab4c7a1bccdc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/41c250ab9f55450a83feab4c7a1bccdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/41c250ab9f55450a83feab4c7a1bccdc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/41c250ab9f55450a83feab4c7a1bccdc"}]}] Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesGetTestJSON-1551776721 Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 41c250ab9f55450a83feab4c7a1bccdc Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesGetTestJSON-1551776721 Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesGetTestJSON-1551776721-project Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 55f8f208eb214ffa8acaf1da83ea10f4 Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesGetTestJSON-1551776721-project Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'f7f461fa-5ea4-4525-b58b-1c77e9d3cd96'} Sep 19 11:29:56.927432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. (HTTP 404) (Request-ID: req-ecb5c0d0-dea1-4d7f-b3d1-94fca9839369) Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:56.932162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:29:56.933351 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:29:56.934939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1be0871e-010d-4f7a-882e-d225382eac26 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] Returning 404 to user: Volume f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1be0871e-010d-4f7a-882e-d225382eac26 tempest-VolumesGetTestJSON-1551776721 tempest-VolumesGetTestJSON-1551776721-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96" status: 404 len: 109 microversion: 2.1 time: 0.036990 Sep 19 11:29:56.936116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 339/678] 10.222.0.81 () {58 vars in 1245 bytes} [Mon Sep 19 11:29:56 2022] GET /compute/v2.1/os-volumes/f7f461fa-5ea4-4525-b58b-1c77e9d3cd96 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:57.417298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:57.418191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:57.426255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.426758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.427207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.428085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.428551 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.428985 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.526054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:57.535779 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:57.537433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:57.538704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-db2d1f83-6896-49c2-afaf-2c15e56b2ada tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1655 microversion: 2.20 time: 0.125358 Sep 19 11:29:57.539356 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 340/679] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:57 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1655 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:57.809293 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-3974daef-f3e0-45dd-8b32-c30c93126f64 req-9ae9721a-d63b-443c-9570-8170c73accae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bcee9ce-4870-41cc-bd56-b05958822d1f", "name": "network-vif-deleted", "tag": "34189864-79e6-4de2-a6e6-1f4a5a6f5640"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:57.825182 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-3974daef-f3e0-45dd-8b32-c30c93126f64 req-9ae9721a-d63b-443c-9570-8170c73accae service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.825800 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-3974daef-f3e0-45dd-8b32-c30c93126f64 req-9ae9721a-d63b-443c-9570-8170c73accae service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.826474 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-3974daef-f3e0-45dd-8b32-c30c93126f64 req-9ae9721a-d63b-443c-9570-8170c73accae service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.838775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-3974daef-f3e0-45dd-8b32-c30c93126f64 req-9ae9721a-d63b-443c-9570-8170c73accae service nova] Creating event network-vif-deleted:34189864-79e6-4de2-a6e6-1f4a5a6f5640 for instance 4bcee9ce-4870-41cc-bd56-b05958822d1f on hv-cinder-82099 Sep 19 11:29:57.844822 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-3974daef-f3e0-45dd-8b32-c30c93126f64 req-9ae9721a-d63b-443c-9570-8170c73accae service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039202 Sep 19 11:29:57.849951 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 340/680] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:58.565286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:58.568006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:58.581858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.583306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.584017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.584923 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.585571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.586002 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.629123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.629699 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.630207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.631068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lazy-loading 'fault' on Instance uuid 4bcee9ce-4870-41cc-bd56-b05958822d1f {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:58.705187 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.714398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.716844 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3097d9c130746ca840bf85f33bc006b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078bf59c33cc43579aeb270262079a37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.718058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-05872c38-dc03-4533-bbfd-5f7266b2b966 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 200 len: 1371 microversion: 2.20 time: 0.157098 Sep 19 11:29:58.718630 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 341/681] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:58 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:59.744200 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:59.745086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:59.751706 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.752212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.752673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.753355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.753805 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.754227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.767306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] HTTP exception thrown: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Request method failure captured: Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f HTTP/1.1 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE_CEkT86VgI6ztA9L1flhznDDkwWoD-mp6U-wwG-_d2dY901H4OsXMQycupmrf8uKuoQVzYr8ooUqwsHQTngZJgbW_Z4VK-jSRgT515suqi3m9x8XzpflXlDMdjqLJu01RqnJUYUQr_4Ccke9IutEZ7X-Q72FhlEtaXJcJ8doSwVA Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:29:59.768940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_078bf59c33cc43579aeb270262079a37", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/078bf59c33cc43579aeb270262079a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}] Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: a3097d9c130746ca840bf85f33bc006b Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:29:59.770726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '4bcee9ce-4870-41cc-bd56-b05958822d1f'} Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:59.771512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:29:59.772793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:29:59.773882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Returning 404 to user: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:59.773882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6a3fe10c-e271-45f5-be9e-29c8f3180401 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 404 len: 111 microversion: 2.20 time: 0.030333 Sep 19 11:29:59.773882 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 341/682] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:59 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:29:59.780151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-43079dce-4747-4b35-b31e-f071ccab0fb8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '.version_select at 0x7ff52162f9d0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:59.799521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-43079dce-4747-4b35-b31e-f071ccab0fb8 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942479834" status: 204 len: 0 microversion: 2.20 time: 0.023808 Sep 19 11:29:59.800131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 342/683] 10.222.0.81 () {60 vars in 1259 bytes} [Mon Sep 19 11:29:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942479834 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 11:30:01.703168 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:01.703611 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:01.710114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.710597 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.711070 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.711775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.712245 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.712672 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.725906 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] HTTP exception thrown: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Request method failure captured: Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f HTTP/1.1 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE_CEkT86VgI6ztA9L1flhznDDkwWoD-mp6U-wwG-_d2dY901H4OsXMQycupmrf8uKuoQVzYr8ooUqwsHQTngZJgbW_Z4VK-jSRgT515suqi3m9x8XzpflXlDMdjqLJu01RqnJUYUQr_4Ccke9IutEZ7X-Q72FhlEtaXJcJ8doSwVA Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:30:01.727457 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_078bf59c33cc43579aeb270262079a37", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/078bf59c33cc43579aeb270262079a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}] Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: a3097d9c130746ca840bf85f33bc006b Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.729385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '4bcee9ce-4870-41cc-bd56-b05958822d1f'} Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:01.730739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.733363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.735301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Returning 404 to user: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:01.735301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-729a38a4-d321-4f06-b5d0-8583b4d0fa84 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 404 len: 111 microversion: 2.20 time: 0.029943 Sep 19 11:30:01.735301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 342/684] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 11:30:01 2022] DELETE /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:30:01.738121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:01.738747 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 4bcee9ce-4870-41cc-bd56-b05958822d1f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:01.745855 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.746350 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.746834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.748104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.748587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.749006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.762090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] HTTP exception thrown: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Request method failure captured: Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f HTTP/1.1 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE_CEkT86VgI6ztA9L1flhznDDkwWoD-mp6U-wwG-_d2dY901H4OsXMQycupmrf8uKuoQVzYr8ooUqwsHQTngZJgbW_Z4VK-jSRgT515suqi3m9x8XzpflXlDMdjqLJu01RqnJUYUQr_4Ccke9IutEZ7X-Q72FhlEtaXJcJ8doSwVA Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:30:01.763704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_078bf59c33cc43579aeb270262079a37", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/078bf59c33cc43579aeb270262079a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}] Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: a3097d9c130746ca840bf85f33bc006b Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.765361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '4bcee9ce-4870-41cc-bd56-b05958822d1f'} Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:01.766489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. Sep 19 11:30:01.767803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:01.769849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Returning 404 to user: Instance 4bcee9ce-4870-41cc-bd56-b05958822d1f could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:01.769849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-338ccfcb-7bfa-43fb-beb2-31de081420af tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f" status: 404 len: 111 microversion: 2.20 time: 0.030910 Sep 19 11:30:01.769849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 343/685] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:01 2022] GET /compute/v2.1/servers/4bcee9ce-4870-41cc-bd56-b05958822d1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:30:02.907591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:02.908101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:02.914452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.914967 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.915407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.916124 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.916583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.917014 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.930117 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] HTTP exception thrown: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Request method failure captured: Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba HTTP/1.1 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFE_CEkT86VgI6ztA9L1flhznDDkwWoD-mp6U-wwG-_d2dY901H4OsXMQycupmrf8uKuoQVzYr8ooUqwsHQTngZJgbW_Z4VK-jSRgT515suqi3m9x8XzpflXlDMdjqLJu01RqnJUYUQr_4Ccke9IutEZ7X-Q72FhlEtaXJcJ8doSwVA Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:30:02.931710 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_078bf59c33cc43579aeb270262079a37", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/078bf59c33cc43579aeb270262079a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}] Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: a3097d9c130746ca840bf85f33bc006b Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.933408 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '37e26364-ddd0-4b3f-aa74-33e3cc7c34ba'} Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:02.934213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.936197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.937608 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Returning 404 to user: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:02.937608 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9f1be1d3-961e-4c42-8268-36f3f19be53e tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 404 len: 111 microversion: 2.20 time: 0.029539 Sep 19 11:30:02.937608 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 343/686] 10.222.0.81 () {60 vars in 1280 bytes} [Mon Sep 19 11:30:02 2022] DELETE /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:30:02.942072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:02.942712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] [instance: 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:02.950106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.951191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.951993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.952604 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.953064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.953490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.966855 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] HTTP exception thrown: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Request method failure captured: Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba HTTP/1.1 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFE_CEkT86VgI6ztA9L1flhznDDkwWoD-mp6U-wwG-_d2dY901H4OsXMQycupmrf8uKuoQVzYr8ooUqwsHQTngZJgbW_Z4VK-jSRgT515suqi3m9x8XzpflXlDMdjqLJu01RqnJUYUQr_4Ccke9IutEZ7X-Q72FhlEtaXJcJ8doSwVA Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:30:02.968474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_078bf59c33cc43579aeb270262079a37", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/078bf59c33cc43579aeb270262079a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/078bf59c33cc43579aeb270262079a37"}]}] Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 078bf59c33cc43579aeb270262079a37 Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1430254592 Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: a3097d9c130746ca840bf85f33bc006b Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1430254592-project Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.970072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '37e26364-ddd0-4b3f-aa74-33e3cc7c34ba'} Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:02.970850 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. Sep 19 11:30:02.972255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:02.973495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] Returning 404 to user: Instance 37e26364-ddd0-4b3f-aa74-33e3cc7c34ba could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:02.973495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-09f76f03-5be5-45d7-af3f-96a75ccadd23 tempest-AttachVolumeShelveTestJSON-1430254592 tempest-AttachVolumeShelveTestJSON-1430254592-project] 10.222.0.81 "GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba" status: 404 len: 111 microversion: 2.20 time: 0.031741 Sep 19 11:30:02.973495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 344/687] 10.222.0.81 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:02 2022] GET /compute/v2.1/servers/37e26364-ddd0-4b3f-aa74-33e3cc7c34ba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:30:29.334575 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-276907058", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:29.342153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:29.342811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:29.390757 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] validate_networks() for None {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:30:29.667997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:30:29.669537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:30:29.670167 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:30:29.670586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:30:29.671003 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:30:29.680140 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:29.680629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:29.681067 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:29.681799 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:29.682257 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:29.682686 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:29.700178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Getting quotas for project f446bc44fa074e80b2b477bdf13bcdcf. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:30:29.704463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Getting quotas for user 7dbae40715f9423b82b1ee34ef30f5ec and project f446bc44fa074e80b2b477bdf13bcdcf. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:30:29.716168 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:30:29.718857 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:30:29.763853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-defd0296-5bf7-4942-b3e9-c622052f3764 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.433098 Sep 19 11:30:29.764502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 344/688] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:30:29.775873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d1004b38-1893-4f36-97e5-e15b460bbb23 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:29.776499 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d1004b38-1893-4f36-97e5-e15b460bbb23 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:29.780420 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:29.781134 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=36 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:29.836457 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d1004b38-1893-4f36-97e5-e15b460bbb23 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:29.844196 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d1004b38-1893-4f36-97e5-e15b460bbb23 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1214 microversion: 2.1 time: 0.072455 Sep 19 11:30:29.844780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 345/689] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:29 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:30.867099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:30.867711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:30.875120 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:30.875596 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:30.876065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:30.876754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:30.877210 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:30.877635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:30.939120 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:30.946774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-37c17cdb-484d-49ba-acca-04dfb9896cd2 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1218 microversion: 2.1 time: 0.083571 Sep 19 11:30:30.947605 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 345/690] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:30 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:31.971466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:31.972037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:31.979442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:31.979971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:31.980422 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:31.981116 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:31.981579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:31.982014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:32.042869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:32.051123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8d180284-a00c-4735-bddf-409de63b485e tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1218 microversion: 2.1 time: 0.083601 Sep 19 11:30:32.051685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 346/691] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:31 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:33.074342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:33.076704 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:33.083622 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:33.084271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:33.084924 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:33.085856 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:33.086331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:33.087059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:33.174794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:33.183586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d7164d83-b3cb-4136-8086-da645cca2cd3 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1272 microversion: 2.1 time: 0.112989 Sep 19 11:30:33.184548 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 346/692] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:33 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:34.210918 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:34.211446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:34.219606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.220409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.220996 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.221885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.222499 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.223183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.438759 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:34.447216 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9f98c269-955c-4006-9bf0-e01dc1595b34 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.240499 Sep 19 11:30:34.447834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 347/693] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:34 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:34.578546 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-4db5e882-bb8d-4cd5-aeed-bb25d6a34272 req-284595d2-b128-41a5-8766-ba4c76f16ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1266ba96-bebf-42ff-aa0f-8dfc51b6d56f", "tag": "a6569b8f-435d-4eee-93af-42acda55fa5c"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:34.591936 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-4db5e882-bb8d-4cd5-aeed-bb25d6a34272 req-284595d2-b128-41a5-8766-ba4c76f16ade service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.593048 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-4db5e882-bb8d-4cd5-aeed-bb25d6a34272 req-284595d2-b128-41a5-8766-ba4c76f16ade service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.593500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-4db5e882-bb8d-4cd5-aeed-bb25d6a34272 req-284595d2-b128-41a5-8766-ba4c76f16ade service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.610571 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-4db5e882-bb8d-4cd5-aeed-bb25d6a34272 req-284595d2-b128-41a5-8766-ba4c76f16ade service nova] Creating event network-changed:a6569b8f-435d-4eee-93af-42acda55fa5c for instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f on hv-cinder-82099 Sep 19 11:30:34.615947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-4db5e882-bb8d-4cd5-aeed-bb25d6a34272 req-284595d2-b128-41a5-8766-ba4c76f16ade service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041659 Sep 19 11:30:34.616821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 347/694] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:35.472489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:35.473749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:35.480061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:35.480806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:35.481254 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:35.482612 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:35.483030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:35.483467 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:35.614846 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:35.622602 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-12537555-64b8-4f83-a3f1-37a9dfe77cba tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.155403 Sep 19 11:30:35.623168 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 348/695] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:35 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:36.646707 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:36.647422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:36.657954 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:36.658721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:36.659500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:36.660238 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:36.660705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:36.661170 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:37.180838 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:37.189786 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a5f3fecd-8077-4efb-aab8-ef8e1e864b1d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.547709 Sep 19 11:30:37.190984 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 348/696] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:36 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:38.220142 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:38.220811 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:38.227480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:38.228043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:38.228437 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:38.229128 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:38.229768 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:38.230329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:38.396840 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:38.411104 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-cf6fb5f6-61f0-495c-80b3-0f9f1c63781d tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.194914 Sep 19 11:30:38.412545 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 349/697] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:38 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:39.434535 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:39.435184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:39.442334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.443245 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.443746 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.444900 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.445617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.446324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.624220 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:39.638142 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-10164361-c404-487f-8e7b-6a31b13ff259 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.207445 Sep 19 11:30:39.638720 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 349/698] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:39 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:40.661973 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:40.662563 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:40.664897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:40.672567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.673066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.673506 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.674528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.674634 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.675131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.809294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:40.817530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-32ecc89b-300b-488d-ab1e-4f13aeb08616 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.159515 Sep 19 11:30:40.818098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 350/699] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:40 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:41.464851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-a5b1bd9d-4f14-430e-8202-ec583f7d1ad1 req-b87e996f-9118-4f19-8554-078481dde85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1266ba96-bebf-42ff-aa0f-8dfc51b6d56f", "name": "network-vif-plugged", "status": "completed", "tag": "a6569b8f-435d-4eee-93af-42acda55fa5c"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:41.470253 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:41.471897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:41.479109 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-a5b1bd9d-4f14-430e-8202-ec583f7d1ad1 req-b87e996f-9118-4f19-8554-078481dde85b service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.480062 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-a5b1bd9d-4f14-430e-8202-ec583f7d1ad1 req-b87e996f-9118-4f19-8554-078481dde85b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.480494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-a5b1bd9d-4f14-430e-8202-ec583f7d1ad1 req-b87e996f-9118-4f19-8554-078481dde85b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.493395 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-a5b1bd9d-4f14-430e-8202-ec583f7d1ad1 req-b87e996f-9118-4f19-8554-078481dde85b service nova] Creating event network-vif-plugged:a6569b8f-435d-4eee-93af-42acda55fa5c for instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f on hv-cinder-82099 Sep 19 11:30:41.499047 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-a5b1bd9d-4f14-430e-8202-ec583f7d1ad1 req-b87e996f-9118-4f19-8554-078481dde85b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037982 Sep 19 11:30:41.499970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 350/700] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:41.841557 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:41.842184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:41.849235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.849728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.850168 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.850859 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.851315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.851736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.989254 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:41.999031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8a5d3311-5eee-4565-8d23-783c94be45f4 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.161290 Sep 19 11:30:41.999824 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 351/701] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:41 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:42.254523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:42.255103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.261522 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.262004 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.262452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.263198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.263866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.264295 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.297972 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9dec0377-43a4-4b1a-88b8-3eff64584dae tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/ips" status: 200 len: 150 microversion: 2.1 time: 0.047604 Sep 19 11:30:42.298899 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 351/702] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:30:42 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:42.312851 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63473bcd-38df-4a67-85da-99113712801e"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:42.316702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.322952 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.323997 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.324450 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.325483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.326215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.326648 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.421325 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Invalid volume: volume 63473bcd-38df-4a67-85da-99113712801e is already attached to instances: 9516b2a9-37fe-418b-8d86-2e6f37f83f72 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: POST /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/os-volume_attachments HTTP/1.1 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 74 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:30:42.422946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {"volumeAttachment": {"volumeId": "63473bcd-38df-4a67-85da-99113712801e"}} Sep 19 11:30:42.424591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Invalid volume: volume 63473bcd-38df-4a67-85da-99113712801e is already attached to instances: 9516b2a9-37fe-418b-8d86-2e6f37f83f72 Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'server_id': 'ea8afe02-fe11-4fab-a7b0-3113b9d6cccd', 'body': {'volumeAttachment': {'volumeId': '63473bcd-38df-4a67-85da-99113712801e'}}} Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 63473bcd-38df-4a67-85da-99113712801e is already attached to instances: 9516b2a9-37fe-418b-8d86-2e6f37f83f72 Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:42.425418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 63473bcd-38df-4a67-85da-99113712801e is already attached to instances: 9516b2a9-37fe-418b-8d86-2e6f37f83f72 Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:42.426816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 63473bcd-38df-4a67-85da-99113712801e is already attached to instances: 9516b2a9-37fe-418b-8d86-2e6f37f83f72 Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 400 to user: Invalid volume: volume 63473bcd-38df-4a67-85da-99113712801e is already attached to instances: 9516b2a9-37fe-418b-8d86-2e6f37f83f72 {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:42.428404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7fc1ef7a-8b81-49b4-a272-8cf1d687773a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115822 Sep 19 11:30:42.433888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 352/703] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:30:42 2022] POST /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:30:42.436055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:42.437016 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.449452 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.449950 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.451158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.453319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.453935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.454591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.488287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:30:42.586051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b69be852-95da-4a51-8948-1d1ad48f939f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 204 len: 0 microversion: 2.1 time: 0.155271 Sep 19 11:30:42.591505 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 352/704] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:30:42 2022] DELETE /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:30:42.598808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:42.600462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.609315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.609823 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.611638 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.612391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.613747 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.614194 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.780445 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:42.789075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1a8c1a91-0593-4adf-b060-12cbb7406ac9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1683 microversion: 2.1 time: 0.196815 Sep 19 11:30:42.790055 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 353/705] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:42 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:43.023069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:43.023539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:43.029549 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.030066 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.030507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.031204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.031658 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.032109 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.163096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:43.171809 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c4e9b376-be52-49d9-99cc-0e30efb06669 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1314 microversion: 2.1 time: 0.153848 Sep 19 11:30:43.172466 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 353/706] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:43 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:43.812546 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:43.813171 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:43.819971 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.820534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.821054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.822121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.822663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.823211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.962114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:43.971075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8f1c0580-7665-4bf9-8cd2-5e3feb81a822 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1683 microversion: 2.1 time: 0.162486 Sep 19 11:30:43.972015 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 354/707] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:43 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:44.194516 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.195130 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:44.202291 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.202779 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.203221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.203944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.204416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.204839 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.373538 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:44.381617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-29292d36-09af-42ef-a55d-8a56e47c082b tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1464 microversion: 2.1 time: 0.191093 Sep 19 11:30:44.382187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 354/708] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:44 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:44.429709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.430398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:44.437131 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.437625 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.438120 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.438828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.439289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.439725 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.465112 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:30:44.542049 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f7cc997f-d762-4c7e-9edf-32a24529521c tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 204 len: 0 microversion: 2.1 time: 0.115880 Sep 19 11:30:44.542884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 355/709] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:30:44 2022] DELETE /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:30:44.550813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.551693 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:44.557712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.558200 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.558639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.559330 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.560523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.560952 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.803024 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:44.812328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5c8f26f8-b98b-42b1-863e-2618ec76fa82 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1470 microversion: 2.1 time: 0.265373 Sep 19 11:30:44.812907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 355/710] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:44 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:44.994745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.995550 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:45.003004 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.003713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.004344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.005212 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.005861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.006469 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.096392 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:45.107317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d9298196-e58b-4715-b411-700ed4a32a59 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1615 microversion: 2.1 time: 0.116167 Sep 19 11:30:45.108762 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 356/711] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:44 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1615 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:45.305354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-a2d13764-14a9-43bb-b7ef-b72b59de423a req-e3ae5920-3828-42c4-82d5-80e2d18e720f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8afe02-fe11-4fab-a7b0-3113b9d6cccd", "name": "network-vif-deleted", "tag": "68a2fa93-058e-42f3-b595-547f56e82dda"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:45.322407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-a2d13764-14a9-43bb-b7ef-b72b59de423a req-e3ae5920-3828-42c4-82d5-80e2d18e720f service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.323029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-a2d13764-14a9-43bb-b7ef-b72b59de423a req-e3ae5920-3828-42c4-82d5-80e2d18e720f service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.323324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-a2d13764-14a9-43bb-b7ef-b72b59de423a req-e3ae5920-3828-42c4-82d5-80e2d18e720f service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.353375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-a2d13764-14a9-43bb-b7ef-b72b59de423a req-e3ae5920-3828-42c4-82d5-80e2d18e720f service nova] Creating event network-vif-deleted:68a2fa93-058e-42f3-b595-547f56e82dda for instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd on hv-cinder-82099 Sep 19 11:30:45.359919 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-a2d13764-14a9-43bb-b7ef-b72b59de423a req-e3ae5920-3828-42c4-82d5-80e2d18e720f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058056 Sep 19 11:30:45.361248 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 356/712] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:45.839690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:45.840967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:45.847276 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.848047 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.848765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.849565 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.850119 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.850642 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.104106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:46.104816 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:46.114508 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:46.117230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.121169 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.124940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-65d75102-c944-41d2-a9db-1eba4323ccb9 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1470 microversion: 2.1 time: 0.292804 Sep 19 11:30:46.131434 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.132357 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 357/713] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:45 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:46.133488 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.134187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.141847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.142751 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-9718fa6f-b331-4bfe-a060-d1dc49a404ab req-5e2ebd89-2c3b-4e4f-ab36-878d90458a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:46.162360 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-9718fa6f-b331-4bfe-a060-d1dc49a404ab req-5e2ebd89-2c3b-4e4f-ab36-878d90458a51 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.163157 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-9718fa6f-b331-4bfe-a060-d1dc49a404ab req-5e2ebd89-2c3b-4e4f-ab36-878d90458a51 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.163919 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-9718fa6f-b331-4bfe-a060-d1dc49a404ab req-5e2ebd89-2c3b-4e4f-ab36-878d90458a51 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.178528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-9718fa6f-b331-4bfe-a060-d1dc49a404ab req-5e2ebd89-2c3b-4e4f-ab36-878d90458a51 service nova] Creating event network-changed:d337a699-9f06-4ec9-8cec-da0fca00d0ab for instance 72e1113c-0919-481f-b283-3f513328bcda on hv-cinder-82099 Sep 19 11:30:46.181180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:30:46.185421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-9718fa6f-b331-4bfe-a060-d1dc49a404ab req-5e2ebd89-2c3b-4e4f-ab36-878d90458a51 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051197 Sep 19 11:30:46.186036 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 358/714] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:46.196731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:46.197685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:46.205741 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.206496 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.207102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.208019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.208645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.209269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.254912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.255702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.256729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.257370 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lazy-loading 'fault' on Instance uuid ea8afe02-fe11-4fab-a7b0-3113b9d6cccd {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:46.318859 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4298650e-bee2-4637-97b4-4a8f30e39d3d tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "DELETE /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 204 len: 0 microversion: 2.1 time: 0.217817 Sep 19 11:30:46.319526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 357/715] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:30:46 2022] DELETE /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:30:46.330843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:46.331541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:46.342879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.343432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.347963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.350112 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.350586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.352666 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.418766 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:46.426967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9985408e-b46a-46b6-bd6a-35f4286fd391 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1332 microversion: 2.1 time: 0.235060 Sep 19 11:30:46.427330 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 359/716] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:46 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1332 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:46.634406 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:46.647439 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e493b2b3-890c-4986-bce3-5c604bfe0c67 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.323093 Sep 19 11:30:46.665866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 358/717] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:46 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:47.150330 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:47.151521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:47.163085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.163845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.164481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.165621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.166283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.167003 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.240913 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:47.251246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c7fda5d9-2822-4288-8da4-ab437faa88be tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1428 microversion: 2.1 time: 0.105024 Sep 19 11:30:47.251861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 360/718] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:47 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:47.376013 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-96cbafc6-b503-446c-95d5-deb4371567a9 req-e1d4817e-28c2-4811-a26d-1e7e8ac3b1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1266ba96-bebf-42ff-aa0f-8dfc51b6d56f", "name": "network-vif-deleted", "tag": "a6569b8f-435d-4eee-93af-42acda55fa5c"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:47.390128 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-96cbafc6-b503-446c-95d5-deb4371567a9 req-e1d4817e-28c2-4811-a26d-1e7e8ac3b1a2 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.391106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-96cbafc6-b503-446c-95d5-deb4371567a9 req-e1d4817e-28c2-4811-a26d-1e7e8ac3b1a2 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.392432 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-96cbafc6-b503-446c-95d5-deb4371567a9 req-e1d4817e-28c2-4811-a26d-1e7e8ac3b1a2 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.418122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-96cbafc6-b503-446c-95d5-deb4371567a9 req-e1d4817e-28c2-4811-a26d-1e7e8ac3b1a2 service nova] Creating event network-vif-deleted:a6569b8f-435d-4eee-93af-42acda55fa5c for instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f on hv-cinder-82099 Sep 19 11:30:47.426289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-96cbafc6-b503-446c-95d5-deb4371567a9 req-e1d4817e-28c2-4811-a26d-1e7e8ac3b1a2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053968 Sep 19 11:30:47.427185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 359/719] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:47.451157 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:47.451791 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:47.463213 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.463705 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.464169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.464878 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.465338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.466307 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.470690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:47.539702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.541400 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.542024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.542681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lazy-loading 'fault' on Instance uuid ea8afe02-fe11-4fab-a7b0-3113b9d6cccd {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:47.593033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:47.601273 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-eda1fbde-9951-469b-8202-2c41d77acf96 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 200 len: 1332 microversion: 2.1 time: 0.154372 Sep 19 11:30:47.602089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 361/720] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:47 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 1332 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:47.675198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:47.675701 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:47.682180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.682671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.683108 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.684011 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.684500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.685100 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.865584 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:47.869387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:47.875275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d8db49bb-15cb-4537-95bd-e5392f65c785 tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1568 microversion: 2.1 time: 0.204444 Sep 19 11:30:47.875985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 360/721] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:47 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:48.277448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.279884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:48.301680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.303878 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.305078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.306526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.310305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.311539 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.359665 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.360243 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.360890 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.361854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lazy-loading 'fault' on Instance uuid 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:48.484888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dbae40715f9423b82b1ee34ef30f5ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f446bc44fa074e80b2b477bdf13bcdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:48.502120 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c27dba78-2843-4adf-943f-71d2bb280904 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 200 len: 1304 microversion: 2.1 time: 0.228103 Sep 19 11:30:48.503298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 362/722] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:48 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:48.625815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.626573 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:48.634107 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.634743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.635204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.636063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.636527 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.636960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.652009 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd HTTP/1.1 Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:30:48.653708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:30:48.655093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'ea8afe02-fe11-4fab-a7b0-3113b9d6cccd'} Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:48.655885 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:30:48.657093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:48.658254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:48.658254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a880565d-8faf-4b43-8fb9-0e58efbe8629 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 404 len: 111 microversion: 2.1 time: 0.034211 Sep 19 11:30:48.658254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 361/723] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:48 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:30:48.667329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-311e3bcb-ef65-43b8-a746-2a94e65aeb2b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '.version_select at 0x7ff521534940>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.689826 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-311e3bcb-ef65-43b8-a746-2a94e65aeb2b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833719367" status: 202 len: 0 microversion: 2.1 time: 0.026566 Sep 19 11:30:48.695489 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 363/724] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 11:30:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1833719367 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:30:48.900515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.901160 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:48.908048 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.908547 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.908989 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.909689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.910992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.911629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.032922 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e8793d50fce45f08c0c4000b7ae75e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221fd300d74c4248a1bfc9b785476477', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:49.047251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e97200c5-c8b9-4511-84fa-098e757fe3db tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 200 len: 1218 microversion: 2.1 time: 0.150446 Sep 19 11:30:49.048270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 362/725] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:48 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:49.469720 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-2f0f6938-0173-496a-8285-fcec6adc5be3 req-812d4b35-58dc-4eaf-9679-4b0c9e460b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72e1113c-0919-481f-b283-3f513328bcda", "name": "network-vif-deleted", "tag": "d337a699-9f06-4ec9-8cec-da0fca00d0ab"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:49.481734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-2f0f6938-0173-496a-8285-fcec6adc5be3 req-812d4b35-58dc-4eaf-9679-4b0c9e460b85 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.482228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-2f0f6938-0173-496a-8285-fcec6adc5be3 req-812d4b35-58dc-4eaf-9679-4b0c9e460b85 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.482672 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-2f0f6938-0173-496a-8285-fcec6adc5be3 req-812d4b35-58dc-4eaf-9679-4b0c9e460b85 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.493328 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-2f0f6938-0173-496a-8285-fcec6adc5be3 req-812d4b35-58dc-4eaf-9679-4b0c9e460b85 service nova] Creating event network-vif-deleted:d337a699-9f06-4ec9-8cec-da0fca00d0ab for instance 72e1113c-0919-481f-b283-3f513328bcda on hv-cinder-82099 Sep 19 11:30:49.499818 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-2f0f6938-0173-496a-8285-fcec6adc5be3 req-812d4b35-58dc-4eaf-9679-4b0c9e460b85 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 Sep 19 11:30:49.500910 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 364/726] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:49.521770 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:49.522261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:49.528865 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.529548 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.529988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.530677 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.530910 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:49.531302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.531734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.531877 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] [instance: 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:49.538696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.539253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.539748 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.540676 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.541398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.542017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.559831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] HTTP exception thrown: Instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f could not be found. Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Request method failure captured: Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f HTTP/1.1 Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFLTfSQOuXq8ABqbWxQrsniUJR-n5J0HuS2vD2gJwZ1QDrYza42H54Pk3DetGtpU3pdZGWuxyEm0xYJ2-kwHB4RMnDodN5xpX-mQXR-MMg7W_JmFiHkeMT8JoMzv4SE8XofIg_SFmCYZd-ItMb6gxf2JOxscnvsMDN_w8ZxjB-yxZqM Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: f446bc44fa074e80b2b477bdf13bcdcf Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesNegativeTest-67941062 Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:30:49.562753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f446bc44fa074e80b2b477bdf13bcdcf", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f446bc44fa074e80b2b477bdf13bcdcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f446bc44fa074e80b2b477bdf13bcdcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f446bc44fa074e80b2b477bdf13bcdcf"}]}] Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesNegativeTest-67941062 Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: f446bc44fa074e80b2b477bdf13bcdcf Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesNegativeTest-67941062 Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesNegativeTest-67941062-project Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 7dbae40715f9423b82b1ee34ef30f5ec Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesNegativeTest-67941062-project Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f could not be found. Sep 19 11:30:49.564199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '1266ba96-bebf-42ff-aa0f-8dfc51b6d56f'} Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f could not be found. Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:49.568574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f could not be found. Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f could not be found. Sep 19 11:30:49.572398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:49.574597 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] Returning 404 to user: Instance 1266ba96-bebf-42ff-aa0f-8dfc51b6d56f could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:49.574597 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-664b96f6-9aab-4dbb-ba23-a3d0bba92942 tempest-VolumesNegativeTest-67941062 tempest-VolumesNegativeTest-67941062-project] 10.222.0.81 "GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f" status: 404 len: 111 microversion: 2.1 time: 0.038870 Sep 19 11:30:49.574597 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 365/727] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:49 2022] GET /compute/v2.1/servers/1266ba96-bebf-42ff-aa0f-8dfc51b6d56f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:30:49.633259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lazy-loading 'services' on Instance uuid 9516b2a9-37fe-418b-8d86-2e6f37f83f72 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:49.729111 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-803b6e30-55ac-4095-ba0a-8fb4cebb7c58 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments/63473bcd-38df-4a67-85da-99113712801e" status: 202 len: 0 microversion: 2.1 time: 0.210770 Sep 19 11:30:49.730034 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 363/728] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:30:49 2022] DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments/63473bcd-38df-4a67-85da-99113712801e => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:30:49.741253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:49.744378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:49.753967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.755318 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.757011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.758161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.758940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.760117 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.802991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-71d021d7-45c1-4384-8cd1-be702b357f22 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067133 Sep 19 11:30:49.804062 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 366/729] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:49 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:50.073260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.074481 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] [instance: 72e1113c-0919-481f-b283-3f513328bcda] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:50.083993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.085000 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.085766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.086727 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.087475 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.087884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.104255 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] HTTP exception thrown: Instance 72e1113c-0919-481f-b283-3f513328bcda could not be found. Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Request method failure captured: Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda HTTP/1.1 Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFGyWkM5ucMGd89Xg2ZHVXa23Jq3CNVrEGPUQ3ZnTSdYredMDtizKa6I_XVmB30eBiNU7Yak59iCIFVxkb3AemAueLNXQZCx6jfAEwVP1_j7PtCp2OTl-jS8pobENXG9uHnW02eiOo0skGDozah6DCVc4_khINRg-p0UwfSg46sRTxA Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 221fd300d74c4248a1bfc9b785476477 Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-TestShelveInstance-71464734 Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:30:50.106469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_221fd300d74c4248a1bfc9b785476477", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/221fd300d74c4248a1bfc9b785476477"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/221fd300d74c4248a1bfc9b785476477"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/221fd300d74c4248a1bfc9b785476477"}]}] Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-TestShelveInstance-71464734 Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 221fd300d74c4248a1bfc9b785476477 Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-TestShelveInstance-71464734 Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-TestShelveInstance-71464734-project Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 6e8793d50fce45f08c0c4000b7ae75e4 Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-TestShelveInstance-71464734-project Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 72e1113c-0919-481f-b283-3f513328bcda could not be found. Sep 19 11:30:50.108065 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '72e1113c-0919-481f-b283-3f513328bcda'} Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72e1113c-0919-481f-b283-3f513328bcda could not be found. Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:50.108973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72e1113c-0919-481f-b283-3f513328bcda could not be found. Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72e1113c-0919-481f-b283-3f513328bcda could not be found. Sep 19 11:30:50.110324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:30:50.112348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Returning 404 to user: Instance 72e1113c-0919-481f-b283-3f513328bcda could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:50.113221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f298518d-e02b-4e33-8206-06d78d90decd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda" status: 404 len: 111 microversion: 2.1 time: 0.045580 Sep 19 11:30:50.114103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 364/730] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:50 2022] GET /compute/v2.1/servers/72e1113c-0919-481f-b283-3f513328bcda => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:30:50.321391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-44ac377e-80a5-4b9f-9816-20099e3c3cfd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] Calling method '.version_select at 0x7ff52155b820>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.347190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-44ac377e-80a5-4b9f-9816-20099e3c3cfd tempest-TestShelveInstance-71464734 tempest-TestShelveInstance-71464734-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-375660481" status: 202 len: 0 microversion: 2.1 time: 0.030032 Sep 19 11:30:50.348820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 367/731] 10.222.0.81 () {58 vars in 1251 bytes} [Mon Sep 19 11:30:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-375660481 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:30:50.816770 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.818918 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:50.826916 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.827709 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.828244 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.829015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.829704 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.830222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.862465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6f13aca3-df10-4db6-a4c6-bcb5fb6ad00b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049583 Sep 19 11:30:50.863076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 365/732] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:50 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:30:50.933933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.934497 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:50.941457 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.942179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.942376 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.943250 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.943703 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.944634 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.979063 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:30:51.068167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2a645b9f-3530-42f8-931b-395b84c18784 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 204 len: 0 microversion: 2.1 time: 0.138335 Sep 19 11:30:51.069922 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 368/733] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:30:50 2022] DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:30:51.079572 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:51.080268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:51.086515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.087015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.087454 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.088353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.088814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.089241 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.474717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:51.484151 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9d13651e-24f3-40f0-8a5b-0dfacba50227 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1680 microversion: 2.1 time: 0.409563 Sep 19 11:30:51.487850 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 366/734] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:51 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1680 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:52.510983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:52.514491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:52.530936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.531440 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.531996 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.532734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.533229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.533717 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.843543 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:52.859024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b95472d9-4e14-4324-b333-002da37d01a8 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1680 microversion: 2.1 time: 0.350207 Sep 19 11:30:52.859671 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 369/735] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:52 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1680 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:53.883544 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:53.884367 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:53.892796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.893625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.894182 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.895119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.895645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.896164 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.999321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:54.013472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9fb1086f-1ada-4002-bcba-6b0b97094570 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1613 microversion: 2.1 time: 0.134671 Sep 19 11:30:54.014058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 367/736] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:53 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1613 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:54.612921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-afaf0d1e-e7cd-42c9-a56f-8dcf0751afbc req-d12e1024-e249-4660-aaff-0c6690bc632f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9516b2a9-37fe-418b-8d86-2e6f37f83f72", "name": "network-vif-deleted", "tag": "c9c48b6c-9661-4ed3-92da-fc33fecc1c02"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:54.636523 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-afaf0d1e-e7cd-42c9-a56f-8dcf0751afbc req-d12e1024-e249-4660-aaff-0c6690bc632f service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.637633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-afaf0d1e-e7cd-42c9-a56f-8dcf0751afbc req-d12e1024-e249-4660-aaff-0c6690bc632f service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.638202 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-afaf0d1e-e7cd-42c9-a56f-8dcf0751afbc req-d12e1024-e249-4660-aaff-0c6690bc632f service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.665580 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-afaf0d1e-e7cd-42c9-a56f-8dcf0751afbc req-d12e1024-e249-4660-aaff-0c6690bc632f service nova] Creating event network-vif-deleted:c9c48b6c-9661-4ed3-92da-fc33fecc1c02 for instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 on hv-cinder-82099 Sep 19 11:30:54.685779 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-afaf0d1e-e7cd-42c9-a56f-8dcf0751afbc req-d12e1024-e249-4660-aaff-0c6690bc632f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079783 Sep 19 11:30:54.687315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 370/737] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:55.039085 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:55.040619 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:55.049954 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.050660 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.051263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.052193 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.052812 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.053397 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.156877 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.159923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.160617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.161096 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lazy-loading 'fault' on Instance uuid 9516b2a9-37fe-418b-8d86-2e6f37f83f72 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:55.276131 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:55.286624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1a1fb37f-ce9b-4a73-8e31-88a74a1d9ec9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 200 len: 1332 microversion: 2.1 time: 0.252767 Sep 19 11:30:55.300521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 368/738] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:55 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 1332 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:56.311700 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:56.312449 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:56.319046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.319540 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.320007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.320710 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.321176 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.321615 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.337872 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 HTTP/1.1 Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:30:56.339526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:30:56.341144 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '9516b2a9-37fe-418b-8d86-2e6f37f83f72'} Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:30:56.342302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:30:56.343498 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:30:56.344730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:30:56.344730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-81132fd6-2479-4c7c-9c65-cf0b1cdf42a7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 404 len: 111 microversion: 2.1 time: 0.034168 Sep 19 11:30:56.344730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 371/739] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:56 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:30:56.350023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-12b3c17e-9209-43d0-8066-59cb7cc71c69 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '.version_select at 0x7ff52155c550>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:56.368448 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-12b3c17e-9209-43d0-8066-59cb7cc71c69 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003002564" status: 202 len: 0 microversion: 2.1 time: 0.022233 Sep 19 11:30:56.369049 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 369/740] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 11:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003002564 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:30:57.041688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-7c375108-bc2e-4162-9739-df69093ec723 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: .version_select at 0x7ff5215a75e0>, body: {"keypair": {"name": "tempest-keypair-23999635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSoYmm17IH3JCvoE+/Mon0LvPoZL5roz2T61jeKy9e+eNKTfBFaeNomkQQXG7eycUoLmBT8GFNm3CX0s75dkaRxKTcwpWcYJimu5Zvx1t8KxC8GRjZX4hyxuqIoTtp65Q=="}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:57.058162 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-7c375108-bc2e-4162-9739-df69093ec723 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:30:57.063580 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-7c375108-bc2e-4162-9739-df69093ec723 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:30:57.090043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-7c375108-bc2e-4162-9739-df69093ec723 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.052082 Sep 19 11:30:57.090834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 372/741] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:30:57 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:59.680566 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1724332833", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bd047f8-e757-4211-9ab1-9e25ad2c412a"}], "security_groups": [{"name": "tempest-securitygroup--1927724422"}], "key_name": "tempest-keypair-23999635", "user_data": "}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:59.705334 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:59.835455 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] validate_networks() for [('4bd047f8-e757-4211-9ab1-9e25ad2c412a', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:31:00.572339 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:31:00.572815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:31:00.573321 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:31:00.573912 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:31:00.574392 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:31:00.584686 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.585472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.586122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.587043 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.587503 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.587984 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.606350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:31:00.610424 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:31:00.622903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:31:00.629558 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:31:00.684325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5066d7cf-c41c-45cf-8bcd-1039fc36bd97 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.010208 Sep 19 11:31:00.688847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 370/742] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:30:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:31:00.697809 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0106467c-a0ee-4ab8-8f38-0e60046e938c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:00.700780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0106467c-a0ee-4ab8-8f38-0e60046e938c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:00.703310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:00.773397 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0106467c-a0ee-4ab8-8f38-0e60046e938c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:00.783161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0106467c-a0ee-4ab8-8f38-0e60046e938c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1240 microversion: 2.1 time: 0.090717 Sep 19 11:31:00.783736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 373/743] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:00 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:01.807312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:01.807992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:01.816815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.817549 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.818153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.819011 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.819645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.820249 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.906229 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:01.913861 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c4107167-0823-4260-bff8-7cdcee28c048 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1292 microversion: 2.1 time: 0.111307 Sep 19 11:31:01.915714 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 371/744] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:01 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:02.938882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:02.940207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:02.947147 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.947643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.948190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:02.948900 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.949365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.949797 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.150302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:03.158887 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-614948f2-77f6-4ba1-b01e-9ae25fe6b358 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.224234 Sep 19 11:31:03.159310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 374/745] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:02 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:03.462912 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-eb317915-de9e-4564-8b16-02d150548718 req-4c4f3d5d-253d-40b0-9d41-7af82001cb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3447abb6-66c7-4950-b7a7-ce7cb9a9db6a", "tag": "afca6c8d-8e3c-40e1-8286-5744e8968eec"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:03.481465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-eb317915-de9e-4564-8b16-02d150548718 req-4c4f3d5d-253d-40b0-9d41-7af82001cb13 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.481960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-eb317915-de9e-4564-8b16-02d150548718 req-4c4f3d5d-253d-40b0-9d41-7af82001cb13 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.482400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-eb317915-de9e-4564-8b16-02d150548718 req-4c4f3d5d-253d-40b0-9d41-7af82001cb13 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.496684 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-eb317915-de9e-4564-8b16-02d150548718 req-4c4f3d5d-253d-40b0-9d41-7af82001cb13 service nova] Creating event network-changed:afca6c8d-8e3c-40e1-8286-5744e8968eec for instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a on hv-cinder-82099 Sep 19 11:31:03.501768 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-eb317915-de9e-4564-8b16-02d150548718 req-4c4f3d5d-253d-40b0-9d41-7af82001cb13 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042902 Sep 19 11:31:03.503037 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 372/746] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:04.183190 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:04.183780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:04.190436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.190929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.191368 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.192095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.192549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.192977 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.326992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:04.334894 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-07ed0355-3ad2-4a53-9522-8ddc401666e1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.155695 Sep 19 11:31:04.335453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 375/747] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:04 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:05.358756 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:05.359604 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:05.365767 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.366259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.366702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.367390 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.368020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.368521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.501986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:05.511158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9daf03ca-301f-472c-807a-e64518a2be29 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.156665 Sep 19 11:31:05.513061 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 373/748] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:05 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:06.535712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:06.536488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:06.543234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.543729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.544196 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.544899 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.545366 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.545798 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.680092 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:06.688731 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0b8fe7b6-66bc-47f7-99df-98a1f7ae0df7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.157387 Sep 19 11:31:06.689316 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 376/749] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:06 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:07.712103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:07.712802 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:07.719234 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.719717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.720177 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.720889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.721320 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.721743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.853847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:07.861605 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7175eadf-569e-4d21-a1eb-cc353a1bd448 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.154022 Sep 19 11:31:07.862199 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 374/750] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:07 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:08.884935 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:08.885547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:08.892847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.893348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.893788 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.894504 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.894956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.895376 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.024347 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:09.032361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4331d852-5ec7-4c36-aaaa-60c1fac9d220 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.151249 Sep 19 11:31:09.032954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 377/751] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:08 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:09.606550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-3eb40bfa-99d6-41da-bc2d-7c785381d92f req-398f12a8-ddd6-4a75-a352-cdedf57e8d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3447abb6-66c7-4950-b7a7-ce7cb9a9db6a", "name": "network-vif-plugged", "status": "completed", "tag": "afca6c8d-8e3c-40e1-8286-5744e8968eec"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:09.616971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-3eb40bfa-99d6-41da-bc2d-7c785381d92f req-398f12a8-ddd6-4a75-a352-cdedf57e8d82 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.617463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-3eb40bfa-99d6-41da-bc2d-7c785381d92f req-398f12a8-ddd6-4a75-a352-cdedf57e8d82 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.617895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-3eb40bfa-99d6-41da-bc2d-7c785381d92f req-398f12a8-ddd6-4a75-a352-cdedf57e8d82 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.629288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-3eb40bfa-99d6-41da-bc2d-7c785381d92f req-398f12a8-ddd6-4a75-a352-cdedf57e8d82 service nova] Creating event network-vif-plugged:afca6c8d-8e3c-40e1-8286-5744e8968eec for instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a on hv-cinder-82099 Sep 19 11:31:09.634010 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-3eb40bfa-99d6-41da-bc2d-7c785381d92f req-398f12a8-ddd6-4a75-a352-cdedf57e8d82 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Sep 19 11:31:09.634599 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 375/752] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:10.054055 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:10.054606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:10.061256 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.061751 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.062229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.062955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.063435 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.063902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.196121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:10.206757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1a881de3-737e-4289-a408-70d06e2baa93 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.156605 Sep 19 11:31:10.207343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 378/753] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:10 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:11.227875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:11.229089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:11.233850 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:11.234562 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:11.241596 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.242090 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.242530 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.243227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.243687 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.244359 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.376806 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:11.384709 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8e128c2b-8b85-4c51-a536-edea0a7cf355 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1366 microversion: 2.1 time: 0.157778 Sep 19 11:31:11.385294 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 376/754] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:11 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:12.409633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:12.410228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:12.412051 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:12.418386 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.418865 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.419299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.420011 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.420464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.420888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.553871 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:12.562167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c34a0e98-e925-4a86-b16c-2bf12b39bcb4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1555 microversion: 2.1 time: 0.156382 Sep 19 11:31:12.562763 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 379/755] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:12 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:12.584015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:12.584595 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:12.591043 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.591525 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.592006 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.592698 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.593152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.593578 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.670171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-cce3fb34-0aa2-485f-8e47-2f29b90158c4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089949 Sep 19 11:31:12.670827 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 377/756] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:31:12 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:13.822611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-81224440-f418-42dc-9736-22cc38c7dcb2 req-db7d31d8-b512-4cad-9009-9dac5d0bf919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3447abb6-66c7-4950-b7a7-ce7cb9a9db6a", "tag": "afca6c8d-8e3c-40e1-8286-5744e8968eec"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:13.832663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-81224440-f418-42dc-9736-22cc38c7dcb2 req-db7d31d8-b512-4cad-9009-9dac5d0bf919 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.833139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-81224440-f418-42dc-9736-22cc38c7dcb2 req-db7d31d8-b512-4cad-9009-9dac5d0bf919 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.833570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-81224440-f418-42dc-9736-22cc38c7dcb2 req-db7d31d8-b512-4cad-9009-9dac5d0bf919 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.844984 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-81224440-f418-42dc-9736-22cc38c7dcb2 req-db7d31d8-b512-4cad-9009-9dac5d0bf919 service nova] Creating event network-changed:afca6c8d-8e3c-40e1-8286-5744e8968eec for instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a on hv-cinder-82099 Sep 19 11:31:13.850081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-81224440-f418-42dc-9736-22cc38c7dcb2 req-db7d31d8-b512-4cad-9009-9dac5d0bf919 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030977 Sep 19 11:31:13.850941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 380/757] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:45.191134 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:45.191914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:45.195790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-171854668", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-847173717", "security_groups": [{"name": "tempest-secgroup-smoke-1916601463"}], "block_device_mapping_v2": [{"uuid": "05d304ae-2ff2-4f17-bc95-5f3336c8ad59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fb35c99b-23b9-4b32-a307-2150c63e0c0a"}]}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:45.306352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] validate_networks() for [('fb35c99b-23b9-4b32-a307-2150c63e0c0a', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:31:45.672881 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:31:45.673594 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:31:45.673970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:31:45.674385 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:31:45.674797 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:31:45.684066 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.684550 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.684985 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.685712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.686171 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.686596 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.703794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:31:45.707688 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Getting quotas for user 7f546dc2d8b24eeea8c6eac968c56806 and project 8351993a1ab94f82bc238a23b2d542d3. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:31:45.762624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:31:45.764744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05d304ae-2ff2-4f17-bc95-5f3336c8ad59',volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:31:45.890449 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-67ad8480-9c2c-4ffb-b36e-ede12c32ba00 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700672 Sep 19 11:31:45.891139 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 378/758] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:31:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:31:45.900453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=17 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:45.901200 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:45.906133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ce9d4c11-b464-46de-bf23-e8591ebdd698 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:45.906886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ce9d4c11-b464-46de-bf23-e8591ebdd698 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:45.965316 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ce9d4c11-b464-46de-bf23-e8591ebdd698 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:45.972355 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ce9d4c11-b464-46de-bf23-e8591ebdd698 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1093 microversion: 2.1 time: 0.073721 Sep 19 11:31:45.972927 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 381/759] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:45 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:47.151355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:47.152579 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:47.158811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.159307 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.159751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.160467 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.160941 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.161357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.240675 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:47.248600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d37dd68e-9baa-44fd-9ce3-56153b7ad888 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1209 microversion: 2.1 time: 0.256608 Sep 19 11:31:47.249170 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 379/760] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:46 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1209 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:48.271530 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:48.272110 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:48.278736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.279412 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.279891 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.280590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.281053 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.281486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.468527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:48.476408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-aef853ee-1255-444c-b9e8-9de08707f2bc tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.208772 Sep 19 11:31:48.476994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 382/761] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:48 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:48.596986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-1db658eb-03a8-4933-b9fe-ab161801bab1 req-a5d16ecf-5dd0-42b8-a6a2-030f1c2f82da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "142b0c02-3675-49cb-ad27-07fe1658b456", "tag": "91d1e660-585f-4a66-85ee-741ce943a844"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:48.607647 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1db658eb-03a8-4933-b9fe-ab161801bab1 req-a5d16ecf-5dd0-42b8-a6a2-030f1c2f82da service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.608438 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1db658eb-03a8-4933-b9fe-ab161801bab1 req-a5d16ecf-5dd0-42b8-a6a2-030f1c2f82da service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.609478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1db658eb-03a8-4933-b9fe-ab161801bab1 req-a5d16ecf-5dd0-42b8-a6a2-030f1c2f82da service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.622978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-1db658eb-03a8-4933-b9fe-ab161801bab1 req-a5d16ecf-5dd0-42b8-a6a2-030f1c2f82da service nova] Creating event network-changed:91d1e660-585f-4a66-85ee-741ce943a844 for instance 142b0c02-3675-49cb-ad27-07fe1658b456 on hv-cinder-82099 Sep 19 11:31:48.627983 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-1db658eb-03a8-4933-b9fe-ab161801bab1 req-a5d16ecf-5dd0-42b8-a6a2-030f1c2f82da service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034506 Sep 19 11:31:48.628735 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 380/762] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:49.500032 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:49.500643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:49.507172 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.507663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.508129 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.508901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.509284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.509720 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.968235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:49.975858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0537d2be-69c1-407f-97d2-26466498dfa9 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.479656 Sep 19 11:31:49.976429 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 383/763] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:49 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:50.999440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:51.000081 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:51.006204 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.006684 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.007118 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.007890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.008343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.008766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.141715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:51.149358 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1091646a-2f00-4ba1-93c6-d02d39af0602 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.154692 Sep 19 11:31:51.149926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 381/764] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:50 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:51.524940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:51.525436 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:51.531739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.532245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.532680 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.533361 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.533813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.534257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.556932 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2679d82b-9f3a-4c61-9827-385bdfafc677 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/ips" status: 200 len: 148 microversion: 2.1 time: 0.035821 Sep 19 11:31:51.557422 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 384/765] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:31:51 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:52.173342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:52.173960 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:52.180412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.180901 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.181342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.182029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.182489 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.182953 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.311092 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:52.319205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9a269079-af2b-4bc5-8ad4-a401fe56c4a8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.149772 Sep 19 11:31:52.319794 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 382/766] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:52 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:52.883209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a969b808-6c50-4887-9247-e5261224ae94"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:52.885697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:52.892097 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.892585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.893029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.893719 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.894179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.894609 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.125323 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-dfde2433-3dfc-4286-b56b-0376536ae4d7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246170 Sep 19 11:31:53.125932 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 385/767] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:31:52 2022] POST /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:53.342861 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:53.343478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:53.349853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.350348 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.350790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.351479 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.351969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.352403 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.488851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:53.496691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-73a1a7a4-92ae-4626-a7e4-eceba5e03642 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.158123 Sep 19 11:31:53.497203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 383/768] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:53 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:54.520390 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:54.521005 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:54.527122 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.527600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.528058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.528738 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.529193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.529617 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.658491 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:54.666184 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b4ca1fb4-98a9-47df-99eb-3f80607e816c tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.150541 Sep 19 11:31:54.666740 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 386/769] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:54 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:55.689732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:55.690362 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:55.693846 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:55.697718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.698215 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.698926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.699635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.700121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.700558 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.715691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:55.829681 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:55.837336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a9cacb7a-b202-451e-86db-8a45409d353b tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.151546 Sep 19 11:31:55.837908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 384/770] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:55 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:56.861495 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:56.862114 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:56.864605 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:56.869866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.870981 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.871421 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.872145 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.872607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.873039 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.005913 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:57.013564 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5db0ba0f-1c7e-4043-9563-b730176623a7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.155912 Sep 19 11:31:57.014141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 387/771] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:56 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:58.036817 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:58.037461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:58.043910 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.044396 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.044830 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.045510 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.045963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.046388 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.180750 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:58.188971 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6a28a965-dc3b-4ab7-863f-9d1388e6b154 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.156252 Sep 19 11:31:58.189552 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 385/772] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:58 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:59.212024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.212661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.219477 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.219988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.220424 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.221102 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.221556 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.221978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.511099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:59.520107 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-95c8645a-d1c0-4b34-a629-4d81f0b11cc4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.311836 Sep 19 11:31:59.520821 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 388/773] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:59 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:59.598248 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a969b808-6c50-4887-9247-e5261224ae94"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:59.600717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.607038 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.607613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.608079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.608766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.609232 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.609662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.688875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Invalid volume: volume a969b808-6c50-4887-9247-e5261224ae94 is already attached to instances: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: POST /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments HTTP/1.1 Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 74 Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:31:59.690625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {"volumeAttachment": {"volumeId": "a969b808-6c50-4887-9247-e5261224ae94"}} Sep 19 11:31:59.692243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Invalid volume: volume a969b808-6c50-4887-9247-e5261224ae94 is already attached to instances: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'server_id': '3447abb6-66c7-4950-b7a7-ce7cb9a9db6a', 'body': {'volumeAttachment': {'volumeId': 'a969b808-6c50-4887-9247-e5261224ae94'}}} Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a969b808-6c50-4887-9247-e5261224ae94 is already attached to instances: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:31:59.693099 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a969b808-6c50-4887-9247-e5261224ae94 is already attached to instances: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:31:59.694301 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a969b808-6c50-4887-9247-e5261224ae94 is already attached to instances: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 400 to user: Invalid volume: volume a969b808-6c50-4887-9247-e5261224ae94 is already attached to instances: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8fd0e725-66ea-4ba7-a1b2-a95c86b5d67c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097853 Sep 19 11:31:59.695537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 386/774] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:31:59 2022] POST /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:31:59.758475 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.758965 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.765676 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.766163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.766599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.767287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.767736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.768305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.849757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lazy-loading 'services' on Instance uuid 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:31:59.892005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-768519a8-e166-4c0a-a4a2-c1d1b9e5576a req-f6094e6e-cdb7-40a6-bc52-7be064e145a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142b0c02-3675-49cb-ad27-07fe1658b456", "name": "network-vif-plugged", "status": "completed", "tag": "91d1e660-585f-4a66-85ee-741ce943a844"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:59.906659 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-768519a8-e166-4c0a-a4a2-c1d1b9e5576a req-f6094e6e-cdb7-40a6-bc52-7be064e145a7 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.907147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-768519a8-e166-4c0a-a4a2-c1d1b9e5576a req-f6094e6e-cdb7-40a6-bc52-7be064e145a7 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.907583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-768519a8-e166-4c0a-a4a2-c1d1b9e5576a req-f6094e6e-cdb7-40a6-bc52-7be064e145a7 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.921342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-768519a8-e166-4c0a-a4a2-c1d1b9e5576a req-f6094e6e-cdb7-40a6-bc52-7be064e145a7 service nova] Creating event network-vif-plugged:91d1e660-585f-4a66-85ee-741ce943a844 for instance 142b0c02-3675-49cb-ad27-07fe1658b456 on hv-cinder-82099 Sep 19 11:31:59.926373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-768519a8-e166-4c0a-a4a2-c1d1b9e5576a req-f6094e6e-cdb7-40a6-bc52-7be064e145a7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039183 Sep 19 11:31:59.926969 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 387/775] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:59.930929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-719e8268-a521-475c-9a7e-8e68fa1d4d5a tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments/a969b808-6c50-4887-9247-e5261224ae94" status: 202 len: 0 microversion: 2.1 time: 0.176103 Sep 19 11:31:59.932300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 389/776] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:31:59 2022] DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments/a969b808-6c50-4887-9247-e5261224ae94 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:31:59.941638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.944018 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.952219 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.952929 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.953599 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.954512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.955177 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.955612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.986917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e0c7f88e-f26e-4f59-b1e9-f825d6bbd597 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049466 Sep 19 11:31:59.987395 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 388/777] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:59 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:00.543090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:00.543812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:00.550442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.550932 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.551375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.552099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.552558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.553006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.683077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:00.690684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d4167135-04c0-4680-a8e4-73f66726eb56 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1265 microversion: 2.1 time: 0.151885 Sep 19 11:32:00.691234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 390/778] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:00 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:00.999781 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:01.001940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:01.008268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.008752 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.009187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.009868 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.010349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.011313 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.040030 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-0cc9c8ed-f95b-48a3-9534-375ed7b89443 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Sep 19 11:32:01.040584 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 389/779] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:00 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:01.714628 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:01.715283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:01.721760 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.722253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.722697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.723393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.723902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.724341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.859573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:01.867257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c840978f-cacf-4167-8f12-acabb3ce05e6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1451 microversion: 2.1 time: 0.157032 Sep 19 11:32:01.867824 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 391/780] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:01 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:01.889276 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:01.889886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:01.895754 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.896268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.896707 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.897420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.897874 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.898296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.028502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:02.036478 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8e994285-60d0-4fc8-8f70-698a1885c584 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1451 microversion: 2.1 time: 0.151444 Sep 19 11:32:02.037122 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 390/781] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:01 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:02.051964 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.054633 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.060393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.060890 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.061362 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.062064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.062525 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.062957 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.093333 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b6342b67-27ef-4a08-be83-594df9dcfb0e tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045206 Sep 19 11:32:02.093738 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 392/782] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:02 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:32:02.161813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.162310 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.168923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.169419 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.169858 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.170555 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.171012 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.171442 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.196934 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:32:02.274955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-0c1543c0-80f2-49e4-8cc1-071064cfeb3d tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 204 len: 0 microversion: 2.1 time: 0.118203 Sep 19 11:32:02.275889 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 391/783] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:32:02 2022] DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:32:02.285839 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.286549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.293423 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.294270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.294941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.295888 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.296556 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.297191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.438618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:02.446528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-96242a2c-b9f5-43f6-b4ae-6288b80f44a9 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1679 microversion: 2.1 time: 0.165530 Sep 19 11:32:02.447099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 393/784] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:02 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:03.471097 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:03.471927 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:03.478197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.478685 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.479127 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.479836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.480294 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.480719 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.618649 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:03.620288 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-d238ea06-41f4-481d-bfc1-5b8497a1c5b5 req-b3dd1aee-39dc-46f5-ace9-79955c90d398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "142b0c02-3675-49cb-ad27-07fe1658b456", "tag": "91d1e660-585f-4a66-85ee-741ce943a844"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:03.627361 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f04b322f-095f-44b6-bac4-5fc6cd58c0c7 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1679 microversion: 2.1 time: 0.160386 Sep 19 11:32:03.628288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 392/785] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:03 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:03.634546 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d238ea06-41f4-481d-bfc1-5b8497a1c5b5 req-b3dd1aee-39dc-46f5-ace9-79955c90d398 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.635907 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d238ea06-41f4-481d-bfc1-5b8497a1c5b5 req-b3dd1aee-39dc-46f5-ace9-79955c90d398 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.636443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-d238ea06-41f4-481d-bfc1-5b8497a1c5b5 req-b3dd1aee-39dc-46f5-ace9-79955c90d398 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.648130 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-d238ea06-41f4-481d-bfc1-5b8497a1c5b5 req-b3dd1aee-39dc-46f5-ace9-79955c90d398 service nova] Creating event network-changed:91d1e660-585f-4a66-85ee-741ce943a844 for instance 142b0c02-3675-49cb-ad27-07fe1658b456 on hv-cinder-82099 Sep 19 11:32:03.653863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-d238ea06-41f4-481d-bfc1-5b8497a1c5b5 req-b3dd1aee-39dc-46f5-ace9-79955c90d398 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037931 Sep 19 11:32:03.654935 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 394/786] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:04.651307 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:04.651984 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:04.659286 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.659933 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.660382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.661084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.661543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.661977 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.753437 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:04.761948 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d40ae45b-f8a9-4dfe-a7b9-2176998a9cbe tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 200 len: 1611 microversion: 2.1 time: 0.115187 Sep 19 11:32:04.762532 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 393/787] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:04 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 1611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:04.981308 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-1a8921b9-7807-419f-ac1e-e7d14f7113b4 req-17b4d0b0-9926-43b4-bc32-6127b8447e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3447abb6-66c7-4950-b7a7-ce7cb9a9db6a", "name": "network-vif-deleted", "tag": "afca6c8d-8e3c-40e1-8286-5744e8968eec"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:04.994194 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-1a8921b9-7807-419f-ac1e-e7d14f7113b4 req-17b4d0b0-9926-43b4-bc32-6127b8447e22 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.995291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-1a8921b9-7807-419f-ac1e-e7d14f7113b4 req-17b4d0b0-9926-43b4-bc32-6127b8447e22 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.995956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-1a8921b9-7807-419f-ac1e-e7d14f7113b4 req-17b4d0b0-9926-43b4-bc32-6127b8447e22 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.010069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-1a8921b9-7807-419f-ac1e-e7d14f7113b4 req-17b4d0b0-9926-43b4-bc32-6127b8447e22 service nova] Creating event network-vif-deleted:afca6c8d-8e3c-40e1-8286-5744e8968eec for instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a on hv-cinder-82099 Sep 19 11:32:05.015571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-1a8921b9-7807-419f-ac1e-e7d14f7113b4 req-17b4d0b0-9926-43b4-bc32-6127b8447e22 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040864 Sep 19 11:32:05.016123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 395/788] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:05.785023 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:05.785759 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:05.792708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.793199 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.793832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.794531 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.795050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.795532 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.809603 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a HTTP/1.1 Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:32:05.811265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:32:05.812947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '3447abb6-66c7-4950-b7a7-ce7cb9a9db6a'} Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:32:05.813790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:32:05.815328 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:32:05.816808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:32:05.816808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-dd64e685-dab7-4edd-a5fb-9f223e2202c1 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 404 len: 111 microversion: 2.1 time: 0.031703 Sep 19 11:32:05.816808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 394/789] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:05 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:32:05.822419 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d80e2e83-0d72-4124-a4a7-37ce6c436410 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '.version_select at 0x7ff521a63b80>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:05.842402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d80e2e83-0d72-4124-a4a7-37ce6c436410 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-23999635" status: 202 len: 0 microversion: 2.1 time: 0.024166 Sep 19 11:32:05.842983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 396/790] 10.222.0.81 () {58 vars in 1215 bytes} [Mon Sep 19 11:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-23999635 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:32:06.459357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c1eeaac5-8748-4f93-b991-1c9783b6c5f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: .version_select at 0x7ff5214ba940>, body: {"keypair": {"name": "tempest-keypair-1068949714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcLMy8SSe1YLAjhnNCESPKqOPfbV+PQ5FUbbSoVzKxQtaSYUQ6LBxzcRtw6I7n6qKRs6kEBPnksSwUkQD7r9I9sMy8OEh4hYWPeKXwJVN1Bq9tbk8XqvCvCZn4io1RySw=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:06.474612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-c1eeaac5-8748-4f93-b991-1c9783b6c5f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:32:06.478337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-c1eeaac5-8748-4f93-b991-1c9783b6c5f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:32:06.499680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c1eeaac5-8748-4f93-b991-1c9783b6c5f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044167 Sep 19 11:32:06.500291 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 395/791] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:32:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:07.987006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1010454036", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4bd047f8-e757-4211-9ab1-9e25ad2c412a"}], "security_groups": [{"name": "tempest-securitygroup--1718545939"}], "key_name": "tempest-keypair-1068949714", "user_data": "}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:08.094001 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] validate_networks() for [('4bd047f8-e757-4211-9ab1-9e25ad2c412a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:32:08.459030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:32:08.459462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:32:08.459992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:32:08.460409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:32:08.460831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:32:08.470051 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.470540 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.470981 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.471713 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.472206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.472640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.490035 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:32:08.493949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Getting quotas for user c23ac045e3db4798be704a4bf37b3c2c and project 0e5ff724699a4dafb37bc5d5e240f0b2. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:32:08.504821 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:32:08.507248 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:32:08.550542 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [da97d46d-f898-4a26-9d97-521dd5f054ce] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 11:32:09.557373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO oslo.messaging._drivers.impl_rabbit [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [da97d46d-f898-4a26-9d97-521dd5f054ce] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 60568. Sep 19 11:32:09.561375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8808ab00-06d4-4171-8c2c-f0d747dde9bf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.578759 Sep 19 11:32:09.562020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 397/792] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:32:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:32:09.574470 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-24b13a6a-eed5-4797-af39-8546c7d8072b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:09.575086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-24b13a6a-eed5-4797-af39-8546c7d8072b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:09.630162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-24b13a6a-eed5-4797-af39-8546c7d8072b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:09.637726 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-24b13a6a-eed5-4797-af39-8546c7d8072b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1242 microversion: 2.1 time: 0.068613 Sep 19 11:32:09.638295 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 396/793] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:09 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:10.660514 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:10.661682 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:10.674558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.674558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.675255 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.676610 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.677517 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.678031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.745728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:10.753342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-75ad4d67-f789-4470-8df1-9f835a20c551 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1300 microversion: 2.1 time: 0.097011 Sep 19 11:32:10.753902 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 398/794] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:10 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:11.776174 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:11.776904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:11.783426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.783961 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.784412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.785336 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.785706 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.786138 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.805641 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:11.994951 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:12.003050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e4c59500-ad98-491a-af0b-cba7737af3f6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.231439 Sep 19 11:32:12.003781 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 397/795] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:11 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:12.078041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-e272b5de-fd3a-432d-ae4b-06677a9537a2 req-616dcffb-04e8-493d-a117-357ad6a8b770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e288bc81-919d-4cff-ba64-69d33daa072f", "tag": "77b628f5-840c-4663-8fcf-7b30686700cd"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:12.089587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-e272b5de-fd3a-432d-ae4b-06677a9537a2 req-616dcffb-04e8-493d-a117-357ad6a8b770 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.090219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-e272b5de-fd3a-432d-ae4b-06677a9537a2 req-616dcffb-04e8-493d-a117-357ad6a8b770 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.090763 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-e272b5de-fd3a-432d-ae4b-06677a9537a2 req-616dcffb-04e8-493d-a117-357ad6a8b770 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.103043 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-e272b5de-fd3a-432d-ae4b-06677a9537a2 req-616dcffb-04e8-493d-a117-357ad6a8b770 service nova] Creating event network-changed:77b628f5-840c-4663-8fcf-7b30686700cd for instance e288bc81-919d-4cff-ba64-69d33daa072f on hv-cinder-82099 Sep 19 11:32:12.108068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-e272b5de-fd3a-432d-ae4b-06677a9537a2 req-616dcffb-04e8-493d-a117-357ad6a8b770 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035982 Sep 19 11:32:12.108678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 399/796] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:13.027326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:13.027986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:13.034349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.034829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.035266 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.035982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.036439 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.036862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.169715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:13.177264 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-380e49f5-38e4-421c-b37f-c03b8fd61fcf tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.154485 Sep 19 11:32:13.177821 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 398/797] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:13 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:14.199169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:14.199927 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:14.206518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.206999 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.207434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.208161 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.208612 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.209034 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.227200 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:14.341159 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:14.348777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-133dcd55-0022-4cbb-9686-d15eab1a3ce0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.154030 Sep 19 11:32:14.349337 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 400/798] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:14 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:15.372137 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:15.372742 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:15.375077 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:15.380231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.380715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.381152 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.381836 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.382290 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.382713 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.514319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:15.521992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-97883a70-9916-4ca5-bc94-dc9a237b6f8c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.154299 Sep 19 11:32:15.522551 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 399/799] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:15 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:16.545073 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:16.545632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:16.548017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:16.553697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.554199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.554653 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.555368 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.555849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.556281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.686873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:16.694432 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-43098e35-acfc-41a9-9132-e71f9a62fc21 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.154113 Sep 19 11:32:16.694995 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 401/800] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:16 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:17.716897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:17.717505 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:17.723923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.724402 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.724831 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.725506 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.725952 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.726369 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.852776 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:17.860420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6a945fd5-5d17-490d-8cdd-0c274f466706 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.147993 Sep 19 11:32:17.860990 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 400/801] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:17 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:18.011981 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-7f14a66b-85f6-4b47-a1d8-6ff4e7ce74b3 req-ccffc2f1-e797-4274-a3b3-3d42c7920ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e288bc81-919d-4cff-ba64-69d33daa072f", "name": "network-vif-plugged", "status": "completed", "tag": "77b628f5-840c-4663-8fcf-7b30686700cd"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:18.021838 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-7f14a66b-85f6-4b47-a1d8-6ff4e7ce74b3 req-ccffc2f1-e797-4274-a3b3-3d42c7920ec1 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.022324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-7f14a66b-85f6-4b47-a1d8-6ff4e7ce74b3 req-ccffc2f1-e797-4274-a3b3-3d42c7920ec1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.022762 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-7f14a66b-85f6-4b47-a1d8-6ff4e7ce74b3 req-ccffc2f1-e797-4274-a3b3-3d42c7920ec1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.036522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-7f14a66b-85f6-4b47-a1d8-6ff4e7ce74b3 req-ccffc2f1-e797-4274-a3b3-3d42c7920ec1 service nova] Creating event network-vif-plugged:77b628f5-840c-4663-8fcf-7b30686700cd for instance e288bc81-919d-4cff-ba64-69d33daa072f on hv-cinder-82099 Sep 19 11:32:18.041320 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-7f14a66b-85f6-4b47-a1d8-6ff4e7ce74b3 req-ccffc2f1-e797-4274-a3b3-3d42c7920ec1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Sep 19 11:32:18.041913 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 402/802] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:18.882306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:18.882917 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:18.889373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.889853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.890287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.890968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.891419 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.891864 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:19.017526 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:19.025556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-83045c56-1d2c-4c83-b288-8bd372b6e73c tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1368 microversion: 2.1 time: 0.146615 Sep 19 11:32:19.026119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 401/803] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:18 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:20.045363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:20.046155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:20.050690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:20.051398 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:20.058411 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.058901 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.059341 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.060056 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.060521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.060951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.191658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:20.200182 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9ab5eb12-9181-4e43-8ac9-cf096dcd840b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1558 microversion: 2.1 time: 0.155723 Sep 19 11:32:20.200747 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 403/804] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:20 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:20.222261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:20.222780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:20.224615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:20.230737 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.231333 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.231972 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.232674 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.233130 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.233556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.309529 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-98b77bef-9270-4dd3-b7d8-f096130390c6 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091232 Sep 19 11:32:20.310124 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 402/805] 10.222.0.81 () {58 vars in 1275 bytes} [Mon Sep 19 11:32:20 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:21.324953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-387d4944-cf20-4973-a365-552be2390a87 req-2329a8f6-3bd3-4826-9e97-5ba81813d044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e288bc81-919d-4cff-ba64-69d33daa072f", "tag": "77b628f5-840c-4663-8fcf-7b30686700cd"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:21.334789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-387d4944-cf20-4973-a365-552be2390a87 req-2329a8f6-3bd3-4826-9e97-5ba81813d044 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.335268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-387d4944-cf20-4973-a365-552be2390a87 req-2329a8f6-3bd3-4826-9e97-5ba81813d044 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.335696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-387d4944-cf20-4973-a365-552be2390a87 req-2329a8f6-3bd3-4826-9e97-5ba81813d044 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.347771 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-387d4944-cf20-4973-a365-552be2390a87 req-2329a8f6-3bd3-4826-9e97-5ba81813d044 service nova] Creating event network-changed:77b628f5-840c-4663-8fcf-7b30686700cd for instance e288bc81-919d-4cff-ba64-69d33daa072f on hv-cinder-82099 Sep 19 11:32:21.352632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-387d4944-cf20-4973-a365-552be2390a87 req-2329a8f6-3bd3-4826-9e97-5ba81813d044 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032330 Sep 19 11:32:21.353269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 404/806] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:57.395209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=7 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:57.396026 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=30 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:57.400586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:57.401095 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:57.408697 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.409181 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.409617 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.410293 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.410744 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.411164 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.437897 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-564b73bc-01bc-4a9f-b880-1cbb850b6786 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/ips" status: 200 len: 149 microversion: 2.1 time: 0.044505 Sep 19 11:32:57.438469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 403/807] 10.222.0.81 () {58 vars in 1248 bytes} [Mon Sep 19 11:32:57 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:58.763958 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=7 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:58.764695 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=18 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:58.769049 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75f7ac6a-abb8-49e9-9813-20189de1d739"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:32:58.771431 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:58.778401 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.778893 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.779338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.780058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.780525 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.780962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.013927 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3cbae6f1-b9bb-4b0d-9d47-14793c6e4440 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "POST /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251563 Sep 19 11:32:59.014535 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 405/808] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:32:58 2022] POST /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:05.586305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:05.586795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:05.593156 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.593638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.594074 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.594759 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.595214 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.595639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.675258 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lazy-loading 'services' on Instance uuid e288bc81-919d-4cff-ba64-69d33daa072f {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:33:05.749263 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-abd837f8-6a88-45ae-9fd7-ce34639c46b4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments/75f7ac6a-abb8-49e9-9813-20189de1d739" status: 202 len: 0 microversion: 2.1 time: 0.166557 Sep 19 11:33:05.749790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 404/809] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:33:05 2022] DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments/75f7ac6a-abb8-49e9-9813-20189de1d739 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:33:05.759152 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:05.761784 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:05.768388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.768868 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.769315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.770054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.770515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.770949 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.801806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-d7722821-8f9b-48eb-9143-e8399a49df55 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Sep 19 11:33:05.802363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 406/810] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:05 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:06.814979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:06.817355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:06.824297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.824780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.825218 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.825908 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.826364 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.826787 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.856515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7615e609-a51c-4c8b-bf7a-fc25c30e0eb2 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045959 Sep 19 11:33:06.857076 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 405/811] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:06 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:33:06.926443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:06.926958 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:06.933817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.934302 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.934742 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.935433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.936096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.936526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.961962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:33:07.034892 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b56737d9-74ad-45da-ae0c-e788db889567 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 204 len: 0 microversion: 2.1 time: 0.115129 Sep 19 11:33:07.035532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 407/812] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:06 2022] DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:33:07.050890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:07.051502 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:07.058138 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.058635 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.059070 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.059783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.060268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.060691 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.193656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:07.201706 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-691c16a3-4316-4d3a-bf7d-c24db65304bc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1682 microversion: 2.1 time: 0.154719 Sep 19 11:33:07.202271 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 406/813] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:07 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:08.225528 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:08.226234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:08.233138 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.233623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.234061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.234750 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.235232 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.235658 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.366070 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:08.373898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ff47d52a-2a9a-481f-a6bf-d9b0b35f6228 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1682 microversion: 2.1 time: 0.152603 Sep 19 11:33:08.374501 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 408/814] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:08 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:09.381228 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-1e94846b-b15e-4edb-bd77-ca340cdaafba req-e26f9a95-6a33-4067-90ec-1aac7cc52041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e288bc81-919d-4cff-ba64-69d33daa072f", "name": "network-vif-deleted", "tag": "77b628f5-840c-4663-8fcf-7b30686700cd"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:09.397008 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:09.397636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:09.409400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e94846b-b15e-4edb-bd77-ca340cdaafba req-e26f9a95-6a33-4067-90ec-1aac7cc52041 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.409890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e94846b-b15e-4edb-bd77-ca340cdaafba req-e26f9a95-6a33-4067-90ec-1aac7cc52041 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.410326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e94846b-b15e-4edb-bd77-ca340cdaafba req-e26f9a95-6a33-4067-90ec-1aac7cc52041 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.420438 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.420942 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.421386 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.422081 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.422792 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.423371 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.436921 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-1e94846b-b15e-4edb-bd77-ca340cdaafba req-e26f9a95-6a33-4067-90ec-1aac7cc52041 service nova] Creating event network-vif-deleted:77b628f5-840c-4663-8fcf-7b30686700cd for instance e288bc81-919d-4cff-ba64-69d33daa072f on hv-cinder-82099 Sep 19 11:33:09.443024 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-1e94846b-b15e-4edb-bd77-ca340cdaafba req-e26f9a95-6a33-4067-90ec-1aac7cc52041 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065716 Sep 19 11:33:09.444029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 407/815] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:09.506791 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c23ac045e3db4798be704a4bf37b3c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5ff724699a4dafb37bc5d5e240f0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:09.515345 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ebab13f0-a328-4bd5-8310-c8e39e87c6b0 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 200 len: 1327 microversion: 2.1 time: 0.122030 Sep 19 11:33:09.520095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 409/816] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:09 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:10.538287 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:10.539020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:10.545265 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.545758 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.546203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.546893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.547361 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.547814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.561387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f HTTP/1.1 Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:10.562993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:10.564629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'e288bc81-919d-4cff-ba64-69d33daa072f'} Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:10.565583 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:10.567088 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:10.568497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:10.568497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4662ab9a-585c-4e82-9fda-89ffafa20da5 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 404 len: 111 microversion: 2.1 time: 0.030895 Sep 19 11:33:10.568497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 408/817] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:10 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:10.574193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a3ae3b6c-ca1c-45bc-aa9e-b4d3d87c4ac3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '.version_select at 0x7ff5216c0ee0>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:10.592306 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a3ae3b6c-ca1c-45bc-aa9e-b4d3d87c4ac3 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068949714" status: 202 len: 0 microversion: 2.1 time: 0.022665 Sep 19 11:33:10.592797 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 410/818] 10.222.0.81 () {58 vars in 1221 bytes} [Mon Sep 19 11:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068949714 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:33:12.345879 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:12.346392 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:12.352711 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.353194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.353630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.354810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.355267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.355689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.368752 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f HTTP/1.1 Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:12.370907 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.372465 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'e288bc81-919d-4cff-ba64-69d33daa072f'} Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:12.373440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.374957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.376569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:12.376569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-501177ec-26cf-4462-bd0a-473b667e7dbc tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 404 len: 111 microversion: 2.1 time: 0.030297 Sep 19 11:33:12.376569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 409/819] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:12 2022] DELETE /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:12.381226 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:12.381840 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: e288bc81-919d-4cff-ba64-69d33daa072f] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:12.388418 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.388907 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.389346 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.390037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.390494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.390923 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.403933 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f HTTP/1.1 Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:12.406058 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.407886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'e288bc81-919d-4cff-ba64-69d33daa072f'} Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:12.408774 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. Sep 19 11:33:12.410547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:12.412148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance e288bc81-919d-4cff-ba64-69d33daa072f could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:12.412148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-fa528ad2-9ccf-426c-8e4a-45afc6eda657 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f" status: 404 len: 111 microversion: 2.1 time: 0.030747 Sep 19 11:33:12.412148 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 411/820] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:12 2022] GET /compute/v2.1/servers/e288bc81-919d-4cff-ba64-69d33daa072f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:13.561227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.561749 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.568536 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.569272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.569729 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.570437 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.571188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.571622 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.587262 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a HTTP/1.1 Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:13.588866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.590412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '3447abb6-66c7-4950-b7a7-ce7cb9a9db6a'} Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:13.591318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.592796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.594266 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:13.594266 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-52514f0e-c7f3-44fe-bbda-3a5820c40308 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 404 len: 111 microversion: 2.1 time: 0.033607 Sep 19 11:33:13.594266 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 410/821] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:13 2022] DELETE /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:13.598954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.599574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.606366 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.606849 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.607290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.608018 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.608479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.608914 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.623632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a HTTP/1.1 Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:13.625292 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.626807 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '3447abb6-66c7-4950-b7a7-ce7cb9a9db6a'} Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:13.627601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. Sep 19 11:33:13.629064 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.630331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance 3447abb6-66c7-4950-b7a7-ce7cb9a9db6a could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:13.630331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b5c7a4a7-6bea-4d49-8ef6-bfc28397cdc4 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a" status: 404 len: 111 microversion: 2.1 time: 0.031697 Sep 19 11:33:13.630331 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 412/822] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:13 2022] GET /compute/v2.1/servers/3447abb6-66c7-4950-b7a7-ce7cb9a9db6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:13.636497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.636994 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.642961 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.643445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.643898 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.644587 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.645044 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.645469 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.659129 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd HTTP/1.1 Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:13.660712 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.662243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'ea8afe02-fe11-4fab-a7b0-3113b9d6cccd'} Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:13.663904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.665354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.666793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:13.666793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d5f92673-b052-4399-b063-f8127ff3ad3b tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 404 len: 111 microversion: 2.1 time: 0.030386 Sep 19 11:33:13.666793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 411/823] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:13 2022] DELETE /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:13.675206 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.675879 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: ea8afe02-fe11-4fab-a7b0-3113b9d6cccd] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.683040 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.683566 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.684041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.684750 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.685201 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.685631 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.702220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd HTTP/1.1 Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:13.704209 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.705758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'ea8afe02-fe11-4fab-a7b0-3113b9d6cccd'} Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:13.706621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. Sep 19 11:33:13.708223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:13.709596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance ea8afe02-fe11-4fab-a7b0-3113b9d6cccd could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:13.709596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-dda94374-3af3-4e21-9006-79bf725d389f tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd" status: 404 len: 111 microversion: 2.1 time: 0.038951 Sep 19 11:33:13.709596 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 413/824] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:13 2022] GET /compute/v2.1/servers/ea8afe02-fe11-4fab-a7b0-3113b9d6cccd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:14.849698 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:14.850196 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:14.857218 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.857698 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.858133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.858818 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.859282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.859725 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.874216 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 HTTP/1.1 Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:14.875745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.877288 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '9516b2a9-37fe-418b-8d86-2e6f37f83f72'} Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:14.878093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.879624 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.881188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:14.881188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b7799936-2558-42da-85d9-4f659fd33869 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 404 len: 111 microversion: 2.1 time: 0.031357 Sep 19 11:33:14.881188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 412/825] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:14 2022] DELETE /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:14.886239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:14.886863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] [instance: 9516b2a9-37fe-418b-8d86-2e6f37f83f72] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:14.893320 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.893810 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.894253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.894945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.895410 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.895878 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.909831 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] HTTP exception thrown: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Request method failure captured: Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 HTTP/1.1 Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFJTgUjqweT04uyhHznTKgjGhHs4q2Q35O_HYgWIm7C-romoqvvXla2VTY-Qr12N9W1CO-M_B0jORZyJas8w-ic_Ll1nc77i-lr6LLQFMSLzfJBNn0D7H7mOAt6-j3ZTPmKDuzT2jnn8NWS4VH3M_oXOwT39eQh4faiH1Lfzlq7npBI Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:14.911285 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0e5ff724699a4dafb37bc5d5e240f0b2", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0e5ff724699a4dafb37bc5d5e240f0b2"}]}] Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 0e5ff724699a4dafb37bc5d5e240f0b2 Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1166189136 Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: c23ac045e3db4798be704a4bf37b3c2c Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-AttachVolumeNegativeTest-1166189136-project Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.912939 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '9516b2a9-37fe-418b-8d86-2e6f37f83f72'} Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:14.913767 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. Sep 19 11:33:14.914953 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:14.916061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] Returning 404 to user: Instance 9516b2a9-37fe-418b-8d86-2e6f37f83f72 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:14.916061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b2660d0b-3fd6-4428-826d-267f58223124 tempest-AttachVolumeNegativeTest-1166189136 tempest-AttachVolumeNegativeTest-1166189136-project] 10.222.0.81 "GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72" status: 404 len: 111 microversion: 2.1 time: 0.030452 Sep 19 11:33:14.916061 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 414/826] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:14 2022] GET /compute/v2.1/servers/9516b2a9-37fe-418b-8d86-2e6f37f83f72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:32.635569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1300631676", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "networks": [{"uuid": "d819139e-6ec1-4698-9321-bbd45ed11f32"}]}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:32.644146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=20 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:32.644826 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:32.848487 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] validate_networks() for [('d819139e-6ec1-4698-9321-bbd45ed11f32', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:33:33.197387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:33:33.198315 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:33:33.198785 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:33:33.199194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:33:33.199600 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:33:33.208231 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.208709 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.209176 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.209898 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.210350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.210774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.226833 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Getting quotas for project 914cee0eaeb1460db8b0c068920a962c. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:33:33.232270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Getting quotas for user cac8337d54a24d0c8fa4c836557bf933 and project 914cee0eaeb1460db8b0c068920a962c. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:33:33.245634 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:33:33.248022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:33:33.294242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-1c02780b-446e-4fd8-81d0-448ab6293b7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663218 Sep 19 11:33:33.294880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 413/827] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:33:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:33:33.305852 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-49b3228d-e5a9-4b24-8da0-2394efa90479 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:33.306475 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-49b3228d-e5a9-4b24-8da0-2394efa90479 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:33.310792 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:33.311620 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:33.424416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-49b3228d-e5a9-4b24-8da0-2394efa90479 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:33.432374 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-49b3228d-e5a9-4b24-8da0-2394efa90479 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1214 microversion: 2.1 time: 0.129802 Sep 19 11:33:33.433142 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 415/828] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:33 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:34.454952 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:34.455570 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:34.461582 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.462073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.462517 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.463720 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.464212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.464644 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.534309 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:34.542083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-05410b3e-7616-4a9c-82a9-dedc08536803 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1272 microversion: 2.1 time: 0.091489 Sep 19 11:33:34.542661 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 414/829] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:34 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:35.565896 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:35.566732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:35.575541 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.576054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.576524 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.577213 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.577673 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.578095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.658221 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-bc973ca7-7211-436f-a663-678189dc615f req-8bd9b0ee-7f26-4326-b7de-b3ce0dd8d06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7894791-3dee-43d9-943f-93f08fe8356b", "tag": "43a691b4-d5de-4f5f-b0ef-77784f77996b"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:35.669358 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-bc973ca7-7211-436f-a663-678189dc615f req-8bd9b0ee-7f26-4326-b7de-b3ce0dd8d06e service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.669986 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-bc973ca7-7211-436f-a663-678189dc615f req-8bd9b0ee-7f26-4326-b7de-b3ce0dd8d06e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.670539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-bc973ca7-7211-436f-a663-678189dc615f req-8bd9b0ee-7f26-4326-b7de-b3ce0dd8d06e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.681809 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-bc973ca7-7211-436f-a663-678189dc615f req-8bd9b0ee-7f26-4326-b7de-b3ce0dd8d06e service nova] Creating event network-changed:43a691b4-d5de-4f5f-b0ef-77784f77996b for instance a7894791-3dee-43d9-943f-93f08fe8356b on hv-cinder-82099 Sep 19 11:33:35.686783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-bc973ca7-7211-436f-a663-678189dc615f req-8bd9b0ee-7f26-4326-b7de-b3ce0dd8d06e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038842 Sep 19 11:33:35.687534 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 415/830] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:35.827138 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:35.835226 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5d9105db-c70f-444b-9900-f93e498fbbcf tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1314 microversion: 2.1 time: 0.273613 Sep 19 11:33:35.835909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 416/831] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:35 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:36.864934 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:36.865660 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:36.872494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.872977 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.873412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.874098 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.874549 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.874968 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.088159 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:37.095753 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-211f18d7-74b7-456d-971c-6a3cf3922489 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1314 microversion: 2.1 time: 0.235437 Sep 19 11:33:37.096362 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 416/832] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:36 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:38.118765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:38.119401 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:38.125781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.126301 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.126742 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.127441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.127931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.128363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.353119 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:38.361889 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a6615a2a-e04f-4369-829a-dded1242eae8 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1314 microversion: 2.1 time: 0.247209 Sep 19 11:33:38.363085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 417/833] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:38 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:39.384400 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:39.385103 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:39.391305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.391866 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.392314 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.392992 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.393445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.393865 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.525244 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:39.532855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a794da14-83da-41b7-9eba-7cf45976da64 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1314 microversion: 2.1 time: 0.152320 Sep 19 11:33:39.533418 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 417/834] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:39 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:40.411541 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-849a88f7-cb55-4b5f-b8ca-14439d1e4956 req-d07c1425-bccd-4ef3-b20e-4d47da5cb2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7894791-3dee-43d9-943f-93f08fe8356b", "name": "network-vif-plugged", "status": "completed", "tag": "43a691b4-d5de-4f5f-b0ef-77784f77996b"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:40.424301 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-849a88f7-cb55-4b5f-b8ca-14439d1e4956 req-d07c1425-bccd-4ef3-b20e-4d47da5cb2f8 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.424795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-849a88f7-cb55-4b5f-b8ca-14439d1e4956 req-d07c1425-bccd-4ef3-b20e-4d47da5cb2f8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.425234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-849a88f7-cb55-4b5f-b8ca-14439d1e4956 req-d07c1425-bccd-4ef3-b20e-4d47da5cb2f8 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.437425 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-849a88f7-cb55-4b5f-b8ca-14439d1e4956 req-d07c1425-bccd-4ef3-b20e-4d47da5cb2f8 service nova] Creating event network-vif-plugged:43a691b4-d5de-4f5f-b0ef-77784f77996b for instance a7894791-3dee-43d9-943f-93f08fe8356b on hv-cinder-82099 Sep 19 11:33:40.442578 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-849a88f7-cb55-4b5f-b8ca-14439d1e4956 req-d07c1425-bccd-4ef3-b20e-4d47da5cb2f8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036673 Sep 19 11:33:40.443553 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 418/835] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:40.555318 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:40.555940 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:40.562804 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.563292 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.563727 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.564449 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.564903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.565331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.737651 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:40.746068 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6809c339-9abb-44ca-a5b5-9e7412f4cff1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1314 microversion: 2.1 time: 0.194853 Sep 19 11:33:40.746636 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 418/836] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:40 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:41.768728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:41.769373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:41.776550 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.777041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.777487 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.778180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.778645 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.779078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.915599 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:41.924048 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-09b078bf-b6e1-4d51-91d5-ec9267d5f027 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1314 microversion: 2.1 time: 0.159495 Sep 19 11:33:41.924617 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 419/837] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:41 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:42.947443 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:42.948094 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:42.954447 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.954944 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.955387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.956112 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.956576 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.957004 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.093378 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:43.101356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ad6be3a3-be1a-48f1-86d7-496ec7d847fd tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1498 microversion: 2.1 time: 0.158567 Sep 19 11:33:43.101949 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 419/838] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:42 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:43.497555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.498755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.500589 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-d67ac1cd-24c5-4b57-97ab-c6d571ddcee8 req-65d1b01d-10d3-452e-943f-4aaf2ee68d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "142b0c02-3675-49cb-ad27-07fe1658b456", "tag": "91d1e660-585f-4a66-85ee-741ce943a844"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:43.505801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:43.507936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.508832 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.508970 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:43.510327 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.510476 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:43.511342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.512322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-d67ac1cd-24c5-4b57-97ab-c6d571ddcee8 req-65d1b01d-10d3-452e-943f-4aaf2ee68d67 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.512678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.512839 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-d67ac1cd-24c5-4b57-97ab-c6d571ddcee8 req-65d1b01d-10d3-452e-943f-4aaf2ee68d67 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.513359 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-d67ac1cd-24c5-4b57-97ab-c6d571ddcee8 req-65d1b01d-10d3-452e-943f-4aaf2ee68d67 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.513956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.561383 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:33:43.657813 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-309e8811-a572-4fdd-9523-a75733de46d4 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "DELETE /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 204 len: 0 microversion: 2.1 time: 0.163201 Sep 19 11:33:43.658781 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 420/839] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:43 2022] DELETE /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:33:43.668544 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.669547 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.680319 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-d67ac1cd-24c5-4b57-97ab-c6d571ddcee8 req-65d1b01d-10d3-452e-943f-4aaf2ee68d67 service nova] Creating event network-changed:91d1e660-585f-4a66-85ee-741ce943a844 for instance 142b0c02-3675-49cb-ad27-07fe1658b456 on hv-cinder-82099 Sep 19 11:33:43.687494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-d67ac1cd-24c5-4b57-97ab-c6d571ddcee8 req-65d1b01d-10d3-452e-943f-4aaf2ee68d67 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190326 Sep 19 11:33:43.688172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 420/840] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:43.693320 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.694011 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.697782 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.698263 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.698694 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.699587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.700069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.700494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.702790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.703349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.703816 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.704619 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.705261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.706060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.727657 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:33:43.808944 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ef657c90-2d5b-4977-9ac1-49444518c913 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 204 len: 0 microversion: 2.1 time: 0.148468 Sep 19 11:33:43.809735 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 421/841] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:43 2022] DELETE /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:33:43.818480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.819241 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.825780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.826120 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.826562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.827277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.827728 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.828845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.855396 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:43.864560 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-4e52030b-c86d-4133-a0f5-7a7a1a7de28a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1576 microversion: 2.1 time: 0.175230 Sep 19 11:33:43.865392 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 421/842] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:43 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:43.965414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:43.973112 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-51b8a43a-78ca-4707-9c33-10d496a2baf3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1504 microversion: 2.1 time: 0.159121 Sep 19 11:33:43.973681 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 422/843] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:43 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:44.889808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:44.890425 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:44.896926 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.897412 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.897852 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.898537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.898994 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.899422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.997222 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:44.997937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:45.004408 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.004970 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.005483 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.006256 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.006793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.007294 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.039614 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:45.047477 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bd1e5796-c317-412c-9770-d727b7488bf6 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1576 microversion: 2.1 time: 0.161826 Sep 19 11:33:45.048158 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 422/844] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:44 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:45.136788 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:45.144363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-b00c147e-b45e-4c5c-a39b-99f986c4d83c tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1504 microversion: 2.1 time: 0.151505 Sep 19 11:33:45.144927 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 423/845] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:44 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:46.071894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:46.072544 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:46.079444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.079978 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.080429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.081178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.081837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.082347 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.167604 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:46.168267 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:46.174669 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.175151 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.175585 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.176297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.176749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.177176 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.606042 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:46.613939 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3e1d1d86-6ef4-4841-90db-d1a96cb69bfb tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1576 microversion: 2.1 time: 0.546116 Sep 19 11:33:46.614512 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 423/846] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:46 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1576 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:46.676880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:46.684753 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bd085866-bacd-40c9-a670-3b6a16d66808 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1504 microversion: 2.1 time: 0.521562 Sep 19 11:33:46.685320 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 424/847] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:46 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1504 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:47.369791 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-cbf61e83-fa85-4d4a-b408-4e9a11b15557 req-6ecd5b56-baa4-4980-89e5-f2098dbceb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142b0c02-3675-49cb-ad27-07fe1658b456", "name": "network-vif-deleted", "tag": "91d1e660-585f-4a66-85ee-741ce943a844"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:47.380146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-cbf61e83-fa85-4d4a-b408-4e9a11b15557 req-6ecd5b56-baa4-4980-89e5-f2098dbceb48 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.380639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-cbf61e83-fa85-4d4a-b408-4e9a11b15557 req-6ecd5b56-baa4-4980-89e5-f2098dbceb48 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.381074 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-cbf61e83-fa85-4d4a-b408-4e9a11b15557 req-6ecd5b56-baa4-4980-89e5-f2098dbceb48 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.393270 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-cbf61e83-fa85-4d4a-b408-4e9a11b15557 req-6ecd5b56-baa4-4980-89e5-f2098dbceb48 service nova] Creating event network-vif-deleted:91d1e660-585f-4a66-85ee-741ce943a844 for instance 142b0c02-3675-49cb-ad27-07fe1658b456 on hv-cinder-82099 Sep 19 11:33:47.398032 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-cbf61e83-fa85-4d4a-b408-4e9a11b15557 req-6ecd5b56-baa4-4980-89e5-f2098dbceb48 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Sep 19 11:33:47.398630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 424/848] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:47.638195 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:47.638820 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:47.645426 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.646168 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.646620 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.647332 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.647917 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.648281 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.683100 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.683601 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.684091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.684540 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lazy-loading 'fault' on Instance uuid 142b0c02-3675-49cb-ad27-07fe1658b456 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:33:47.709273 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:47.709991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:47.716835 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.717591 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.718251 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.718966 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.719434 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.719890 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.727070 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:47.735946 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2cbfed5c-56a3-464b-9fcd-7457b90c208f tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 200 len: 1229 microversion: 2.1 time: 0.102679 Sep 19 11:33:47.737141 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 425/849] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:47 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:47.753500 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.754002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.754427 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.754876 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lazy-loading 'fault' on Instance uuid a7894791-3dee-43d9-943f-93f08fe8356b {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:33:47.795105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:47.802656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c0085757-778b-4541-a5b2-d8d92eda72ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 200 len: 1304 microversion: 2.1 time: 0.098020 Sep 19 11:33:47.803229 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 425/850] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:47 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:48.760012 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:48.760624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 142b0c02-3675-49cb-ad27-07fe1658b456] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:48.766993 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.767485 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.768027 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.768724 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.769189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.769617 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.782706 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] HTTP exception thrown: Instance 142b0c02-3675-49cb-ad27-07fe1658b456 could not be found. Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Request method failure captured: Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 HTTP/1.1 Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFHxDhl6Sncnup-nAVMm87xtYXrbAxprj9Iq60CXr2zkjM6iKJfyFJwDvgGeJlKIEV484IixBE66SIQBc8IJnhtEyHoQaI-HiQnhqRDO6R4_t8fGTFLfEuXbQTC6wpJzQc10suS06Z8rHU49IUKCZS1pRrkEx9SH5yGu6ORQ-SpJomE Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:48.784446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8351993a1ab94f82bc238a23b2d542d3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}] Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 7f546dc2d8b24eeea8c6eac968c56806 Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 142b0c02-3675-49cb-ad27-07fe1658b456 could not be found. Sep 19 11:33:48.786088 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '142b0c02-3675-49cb-ad27-07fe1658b456'} Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 142b0c02-3675-49cb-ad27-07fe1658b456 could not be found. Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:48.787080 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 142b0c02-3675-49cb-ad27-07fe1658b456 could not be found. Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 142b0c02-3675-49cb-ad27-07fe1658b456 could not be found. Sep 19 11:33:48.788691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.790365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Returning 404 to user: Instance 142b0c02-3675-49cb-ad27-07fe1658b456 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:48.790365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4b58e3fa-2563-4f81-a8ee-9e1715597ae7 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456" status: 404 len: 111 microversion: 2.1 time: 0.030502 Sep 19 11:33:48.790365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 426/851] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:48 2022] GET /compute/v2.1/servers/142b0c02-3675-49cb-ad27-07fe1658b456 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:48.827751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:48.828588 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: a7894791-3dee-43d9-943f-93f08fe8356b] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:48.835119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.835689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.836161 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.836858 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.837324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.837798 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.852715 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] HTTP exception thrown: Instance a7894791-3dee-43d9-943f-93f08fe8356b could not be found. Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Request method failure captured: Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b HTTP/1.1 Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFOLTq41z0R9MDh4FoOTYFC1DdaYbFJp-32fFOAoxjfYsQZQZrh4O5njJCIdeYrwEhyYr97T6LP3rcmUEj_lFw2ef7_BFr2inh0ZJiproMyIsuSBgrmzCHz86qSdQ0MpSkaWG5Rh1VQS6hVjSA5k020TrIIC7gZTZ73aJ1N3K10c3Ao Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 914cee0eaeb1460db8b0c068920a962c Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesActionsTest-395534218 Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:48.854520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_914cee0eaeb1460db8b0c068920a962c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/914cee0eaeb1460db8b0c068920a962c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/914cee0eaeb1460db8b0c068920a962c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/914cee0eaeb1460db8b0c068920a962c"}]}] Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesActionsTest-395534218 Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 914cee0eaeb1460db8b0c068920a962c Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesActionsTest-395534218 Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesActionsTest-395534218-project Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: cac8337d54a24d0c8fa4c836557bf933 Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesActionsTest-395534218-project Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance a7894791-3dee-43d9-943f-93f08fe8356b could not be found. Sep 19 11:33:48.856173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'a7894791-3dee-43d9-943f-93f08fe8356b'} Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7894791-3dee-43d9-943f-93f08fe8356b could not be found. Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:48.857084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7894791-3dee-43d9-943f-93f08fe8356b could not be found. Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7894791-3dee-43d9-943f-93f08fe8356b could not be found. Sep 19 11:33:48.858773 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:48.860680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Returning 404 to user: Instance a7894791-3dee-43d9-943f-93f08fe8356b could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:48.860680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-73b85377-5c6a-4564-9ca6-984b40b7b2cc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b" status: 404 len: 111 microversion: 2.1 time: 0.032988 Sep 19 11:33:48.860680 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 426/852] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:48 2022] GET /compute/v2.1/servers/a7894791-3dee-43d9-943f-93f08fe8356b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:48.914428 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-958599208", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "networks": [{"uuid": "d819139e-6ec1-4698-9321-bbd45ed11f32"}]}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:48.971422 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] validate_networks() for [('d819139e-6ec1-4698-9321-bbd45ed11f32', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:33:49.484184 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-6473f4fd-3718-40bc-9304-ca233632b0f2 req-518cac19-2282-411c-9f7c-2e823e17fafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7894791-3dee-43d9-943f-93f08fe8356b", "name": "network-vif-deleted", "tag": "43a691b4-d5de-4f5f-b0ef-77784f77996b"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:49.494747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-6473f4fd-3718-40bc-9304-ca233632b0f2 req-518cac19-2282-411c-9f7c-2e823e17fafd service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.495252 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-6473f4fd-3718-40bc-9304-ca233632b0f2 req-518cac19-2282-411c-9f7c-2e823e17fafd service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.495686 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-6473f4fd-3718-40bc-9304-ca233632b0f2 req-518cac19-2282-411c-9f7c-2e823e17fafd service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.506628 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-6473f4fd-3718-40bc-9304-ca233632b0f2 req-518cac19-2282-411c-9f7c-2e823e17fafd service nova] Creating event network-vif-deleted:43a691b4-d5de-4f5f-b0ef-77784f77996b for instance a7894791-3dee-43d9-943f-93f08fe8356b on hv-cinder-82099 Sep 19 11:33:49.512642 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-6473f4fd-3718-40bc-9304-ca233632b0f2 req-518cac19-2282-411c-9f7c-2e823e17fafd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 Sep 19 11:33:49.513217 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 427/853] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:49.580106 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:33:49.580649 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:33:49.581155 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:33:49.581562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:33:49.581975 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:33:49.590898 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.591379 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.591843 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.592570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.593036 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.593448 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.609871 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Getting quotas for project 914cee0eaeb1460db8b0c068920a962c. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:33:49.613955 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Getting quotas for user cac8337d54a24d0c8fa4c836557bf933 and project 914cee0eaeb1460db8b0c068920a962c. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:33:49.625233 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:33:49.627493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:33:49.673215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-59e0adeb-28eb-413a-ab15-cf642e557842 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762337 Sep 19 11:33:49.673563 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 427/854] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:33:49.685872 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-19c18ec9-97f9-4e15-8da6-d505fa0d09bc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:49.686590 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-19c18ec9-97f9-4e15-8da6-d505fa0d09bc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:49.743782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-19c18ec9-97f9-4e15-8da6-d505fa0d09bc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:49.751010 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-19c18ec9-97f9-4e15-8da6-d505fa0d09bc tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1213 microversion: 2.1 time: 0.069206 Sep 19 11:33:49.751648 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 428/855] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:49 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:50.773988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:50.775894 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:50.782924 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.783538 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.784097 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.784804 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.785258 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.785697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.861026 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:50.869343 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-0f5d14ba-7dd6-4eb4-a71b-1eea3de5735a tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1271 microversion: 2.1 time: 0.100482 Sep 19 11:33:50.869916 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 428/856] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:50 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:51.887233 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:51.888761 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-54bf67e4-3b1e-4d12-9e37-5453cff4982b req-737d24ef-6df7-421f-9e7f-8ff5881fbd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4043326f-606a-4ce6-81d9-95bbd73358d0", "tag": "33c62641-505f-4f2e-b389-5020e568a62a"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:51.889407 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:51.907611 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-54bf67e4-3b1e-4d12-9e37-5453cff4982b req-737d24ef-6df7-421f-9e7f-8ff5881fbd6b service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.908393 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.908957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.909462 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.910543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.911079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.911585 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.920269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-54bf67e4-3b1e-4d12-9e37-5453cff4982b req-737d24ef-6df7-421f-9e7f-8ff5881fbd6b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.921116 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-54bf67e4-3b1e-4d12-9e37-5453cff4982b req-737d24ef-6df7-421f-9e7f-8ff5881fbd6b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.937142 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-54bf67e4-3b1e-4d12-9e37-5453cff4982b req-737d24ef-6df7-421f-9e7f-8ff5881fbd6b service nova] Creating event network-changed:33c62641-505f-4f2e-b389-5020e568a62a for instance 4043326f-606a-4ce6-81d9-95bbd73358d0 on hv-cinder-82099 Sep 19 11:33:51.942934 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-54bf67e4-3b1e-4d12-9e37-5453cff4982b req-737d24ef-6df7-421f-9e7f-8ff5881fbd6b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061748 Sep 19 11:33:51.948354 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 429/857] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:51.955429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:33:51.972793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:51.973890 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:51.985988 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.986861 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.987308 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.988066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.988526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.988952 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.076699 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-550f2f28-ea6a-48d4-9ef1-17410a229b4a tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 204 len: 0 microversion: 2.1 time: 0.197947 Sep 19 11:33:52.077507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 429/858] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:51 2022] DELETE /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:33:52.086483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:52.088128 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:52.094904 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.095476 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.096022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.096793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.097329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.097847 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.346149 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:52.355041 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c7546058-50c8-4a6e-a2f2-67a1f897edc1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.405030 Sep 19 11:33:52.355978 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 430/859] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:51 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:52.360790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-f3b800f6-c373-4632-b204-869f74b144bf req-87827798-fad7-4d01-8f18-46ec5db2f022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db664764-a39e-4a24-b39d-f4e30af8e0ae", "tag": "c02c72df-11f2-43e9-90cc-22fd0be2f051"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:52.370627 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f3b800f6-c373-4632-b204-869f74b144bf req-87827798-fad7-4d01-8f18-46ec5db2f022 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.371185 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f3b800f6-c373-4632-b204-869f74b144bf req-87827798-fad7-4d01-8f18-46ec5db2f022 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.371686 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f3b800f6-c373-4632-b204-869f74b144bf req-87827798-fad7-4d01-8f18-46ec5db2f022 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.386228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-f3b800f6-c373-4632-b204-869f74b144bf req-87827798-fad7-4d01-8f18-46ec5db2f022 service nova] Creating event network-changed:c02c72df-11f2-43e9-90cc-22fd0be2f051 for instance db664764-a39e-4a24-b39d-f4e30af8e0ae on hv-cinder-82099 Sep 19 11:33:52.391433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-f3b800f6-c373-4632-b204-869f74b144bf req-87827798-fad7-4d01-8f18-46ec5db2f022 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033983 Sep 19 11:33:52.392150 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 431/860] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:52.403440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:52.413416 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f9cfb2ec-d1ac-4eaa-8654-fff155aac11d tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1576 microversion: 2.1 time: 0.331446 Sep 19 11:33:52.414084 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 430/861] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:52 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1576 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:53.378712 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:53.379348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:53.386447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.386940 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.387385 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.388124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.388589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.389019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.393305 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:53.437808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:53.438420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:53.445323 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.446093 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.447010 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.447704 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.448191 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.448618 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.894962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:53.902802 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-35d1a9c3-d4a7-4748-a804-a583b78e61b0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.528377 Sep 19 11:33:53.903488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 432/862] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:53 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:53.906585 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:53.915584 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-91f6671a-20ec-4524-a538-6ef7035de077 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1576 microversion: 2.1 time: 0.480909 Sep 19 11:33:53.916741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 431/863] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:53 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1576 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:54.814138 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-c75f273a-05e8-436c-a42e-74fef3f7f569 req-1a68d4cb-786b-4883-ac21-dbf8a4910e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4043326f-606a-4ce6-81d9-95bbd73358d0", "name": "network-vif-deleted", "tag": "33c62641-505f-4f2e-b389-5020e568a62a"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:54.824113 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-c75f273a-05e8-436c-a42e-74fef3f7f569 req-1a68d4cb-786b-4883-ac21-dbf8a4910e38 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.824600 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-c75f273a-05e8-436c-a42e-74fef3f7f569 req-1a68d4cb-786b-4883-ac21-dbf8a4910e38 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.825109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-c75f273a-05e8-436c-a42e-74fef3f7f569 req-1a68d4cb-786b-4883-ac21-dbf8a4910e38 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.836268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-c75f273a-05e8-436c-a42e-74fef3f7f569 req-1a68d4cb-786b-4883-ac21-dbf8a4910e38 service nova] Creating event network-vif-deleted:33c62641-505f-4f2e-b389-5020e568a62a for instance 4043326f-606a-4ce6-81d9-95bbd73358d0 on hv-cinder-82099 Sep 19 11:33:54.841584 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-c75f273a-05e8-436c-a42e-74fef3f7f569 req-1a68d4cb-786b-4883-ac21-dbf8a4910e38 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Sep 19 11:33:54.842165 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 433/864] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:54.925484 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:54.926102 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:54.932536 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.933022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.933497 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.934210 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.934671 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.935154 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.940319 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:54.941031 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:54.947909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.948406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.948857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.949555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.950049 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.950490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.953655 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:55.034461 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f546dc2d8b24eeea8c6eac968c56806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8351993a1ab94f82bc238a23b2d542d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:55.042276 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1a408240-a950-4951-b1b2-bc252e8945be tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 200 len: 1390 microversion: 2.1 time: 0.106145 Sep 19 11:33:55.042847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 434/865] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:54 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:55.095247 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:55.103111 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-39c32a64-3446-459a-a743-22083192db83 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.181424 Sep 19 11:33:55.103675 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 432/866] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:54 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:56.066317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.067419 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: 4043326f-606a-4ce6-81d9-95bbd73358d0] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.074649 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.075163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.075675 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.076479 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.076958 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.077433 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.091342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] HTTP exception thrown: Instance 4043326f-606a-4ce6-81d9-95bbd73358d0 could not be found. Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Request method failure captured: Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 HTTP/1.1 Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFHxDhl6Sncnup-nAVMm87xtYXrbAxprj9Iq60CXr2zkjM6iKJfyFJwDvgGeJlKIEV484IixBE66SIQBc8IJnhtEyHoQaI-HiQnhqRDO6R4_t8fGTFLfEuXbQTC6wpJzQc10suS06Z8rHU49IUKCZS1pRrkEx9SH5yGu6ORQ-SpJomE Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:56.093069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8351993a1ab94f82bc238a23b2d542d3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}] Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 7f546dc2d8b24eeea8c6eac968c56806 Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 4043326f-606a-4ce6-81d9-95bbd73358d0 could not be found. Sep 19 11:33:56.094493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '4043326f-606a-4ce6-81d9-95bbd73358d0'} Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4043326f-606a-4ce6-81d9-95bbd73358d0 could not be found. Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:56.095228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4043326f-606a-4ce6-81d9-95bbd73358d0 could not be found. Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4043326f-606a-4ce6-81d9-95bbd73358d0 could not be found. Sep 19 11:33:56.096527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.097707 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Returning 404 to user: Instance 4043326f-606a-4ce6-81d9-95bbd73358d0 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:56.097707 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-028032de-c17f-4b1b-b8ea-8986c6eb03e8 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0" status: 404 len: 111 microversion: 2.1 time: 0.032779 Sep 19 11:33:56.097707 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 435/867] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/4043326f-606a-4ce6-81d9-95bbd73358d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:56.124483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.125117 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.131531 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.132055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.132503 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.133200 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.133662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.134101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.264965 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:56.273665 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-43e22b11-05c5-4c50-a758-073d519445ce tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.153010 Sep 19 11:33:56.274734 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 433/868] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:56.548078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.548590 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.554616 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.554967 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.555413 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.556181 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.556643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.557079 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.570754 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] HTTP exception thrown: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Request method failure captured: Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 HTTP/1.1 Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFHxDhl6Sncnup-nAVMm87xtYXrbAxprj9Iq60CXr2zkjM6iKJfyFJwDvgGeJlKIEV484IixBE66SIQBc8IJnhtEyHoQaI-HiQnhqRDO6R4_t8fGTFLfEuXbQTC6wpJzQc10suS06Z8rHU49IUKCZS1pRrkEx9SH5yGu6ORQ-SpJomE Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:33:56.572881 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8351993a1ab94f82bc238a23b2d542d3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}] Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 7f546dc2d8b24eeea8c6eac968c56806 Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.574492 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'ae508c34-2fb3-4348-b3a0-df59607692b5'} Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:56.575562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.577101 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.578714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Returning 404 to user: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:56.578714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c57d13d1-1fab-4fab-993b-1aa55c117d21 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "DELETE /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 404 len: 111 microversion: 2.1 time: 0.030050 Sep 19 11:33:56.578714 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 436/869] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:33:56 2022] DELETE /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:56.582920 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.583543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] [instance: ae508c34-2fb3-4348-b3a0-df59607692b5] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.590131 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.590648 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.591097 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.591815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.592285 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.592714 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.605828 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] HTTP exception thrown: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Request method failure captured: Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 HTTP/1.1 Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFHxDhl6Sncnup-nAVMm87xtYXrbAxprj9Iq60CXr2zkjM6iKJfyFJwDvgGeJlKIEV484IixBE66SIQBc8IJnhtEyHoQaI-HiQnhqRDO6R4_t8fGTFLfEuXbQTC6wpJzQc10suS06Z8rHU49IUKCZS1pRrkEx9SH5yGu6ORQ-SpJomE Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:33:56.607524 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_8351993a1ab94f82bc238a23b2d542d3", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/8351993a1ab94f82bc238a23b2d542d3"}]}] Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 8351993a1ab94f82bc238a23b2d542d3 Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-TestVolumeBootPattern-983423422 Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 7f546dc2d8b24eeea8c6eac968c56806 Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-TestVolumeBootPattern-983423422-project Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.609106 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': 'ae508c34-2fb3-4348-b3a0-df59607692b5'} Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:33:56.610148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. Sep 19 11:33:56.611405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:33:56.612650 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Returning 404 to user: Instance ae508c34-2fb3-4348-b3a0-df59607692b5 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:33:56.612650 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-560eb4b9-16b9-4719-9dc4-600e17d2bc63 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5" status: 404 len: 111 microversion: 2.1 time: 0.029971 Sep 19 11:33:56.612650 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 434/870] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/ae508c34-2fb3-4348-b3a0-df59607692b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:33:57.297210 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:57.297777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:57.304330 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.304828 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.305272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.306570 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.307042 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.307473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.433854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:57.441494 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ef7eeb7c-c330-4404-b991-cc8a80676107 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.148272 Sep 19 11:33:57.442077 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 437/871] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:57 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:57.897363 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-d95ed97a-d5cf-4f88-8fb3-b9f6c456dc54 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] Calling method '.version_select at 0x7ff5214f0dc0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:57.927262 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-d95ed97a-d5cf-4f88-8fb3-b9f6c456dc54 tempest-TestVolumeBootPattern-983423422 tempest-TestVolumeBootPattern-983423422-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-847173717" status: 202 len: 0 microversion: 2.1 time: 0.033737 Sep 19 11:33:57.931424 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 435/872] 10.222.0.81 () {58 vars in 1260 bytes} [Mon Sep 19 11:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-847173717 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:33:58.464409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:58.464886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:58.471688 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.472239 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.473217 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.473929 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.474393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.475509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.500630 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-02240cba-94f5-47cf-a276-7fe6d322d106 req-9571f8ce-6a0f-43a1-b77d-83c9a49454de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db664764-a39e-4a24-b39d-f4e30af8e0ae", "name": "network-vif-plugged", "status": "completed", "tag": "c02c72df-11f2-43e9-90cc-22fd0be2f051"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:33:58.530515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-02240cba-94f5-47cf-a276-7fe6d322d106 req-9571f8ce-6a0f-43a1-b77d-83c9a49454de service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.531471 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-02240cba-94f5-47cf-a276-7fe6d322d106 req-9571f8ce-6a0f-43a1-b77d-83c9a49454de service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.532131 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-02240cba-94f5-47cf-a276-7fe6d322d106 req-9571f8ce-6a0f-43a1-b77d-83c9a49454de service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.555347 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-02240cba-94f5-47cf-a276-7fe6d322d106 req-9571f8ce-6a0f-43a1-b77d-83c9a49454de service nova] Creating event network-vif-plugged:c02c72df-11f2-43e9-90cc-22fd0be2f051 for instance db664764-a39e-4a24-b39d-f4e30af8e0ae on hv-cinder-82099 Sep 19 11:33:58.562157 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-02240cba-94f5-47cf-a276-7fe6d322d106 req-9571f8ce-6a0f-43a1-b77d-83c9a49454de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066410 Sep 19 11:33:58.563513 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 436/873] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:58.641663 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:58.655941 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3109e754-eca2-4eb5-9fcc-a2abff0cbc58 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.195508 Sep 19 11:33:58.668759 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 438/874] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:58 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:59.679785 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:59.680774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:59.687059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.687853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.688461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.689275 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.689902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.690490 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.754244 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:59.855177 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:59.863873 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ce6985cf-43fd-498f-aac1-105a4658bebe tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1313 microversion: 2.1 time: 0.188869 Sep 19 11:33:59.864683 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 437/875] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:59 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:00.886911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:00.887640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:00.890246 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:00.891123 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:00.897268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.897679 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.898124 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.898829 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.899286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.900465 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.184021 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:01.191693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-58bdd097-aafc-403b-92a0-91d6b69438f0 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1498 microversion: 2.1 time: 0.308933 Sep 19 11:34:01.192286 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 439/876] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:00 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1498 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:01.647406 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:01.648153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:01.654694 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.655472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.656147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.656860 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.657320 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.657746 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.684540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:34:01.763327 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-db3b9504-6de6-482c-a3f4-dc13ef2aef90 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "DELETE /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 204 len: 0 microversion: 2.1 time: 0.119453 Sep 19 11:34:01.764379 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 438/877] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:34:01 2022] DELETE /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:34:01.775016 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:01.776317 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:01.782722 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.783215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.783656 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.784406 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.784867 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.785297 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.917163 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:01.926211 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6f052263-a69d-4ced-a042-b82552a52fd3 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1504 microversion: 2.1 time: 0.157413 Sep 19 11:34:01.926783 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 440/878] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:01 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:02.951020 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:02.951935 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:02.954552 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:02.960731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.961224 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.961936 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.962653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.963112 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.963796 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.151987 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:03.164839 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c8b4ff01-a367-4c03-845d-eb75331da747 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1504 microversion: 2.1 time: 0.218710 Sep 19 11:34:03.180185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 439/879] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:02 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:03.655227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-ea57406f-c726-445c-bbc1-e884c0058100 req-21337adc-0563-47d5-9daa-83a018c0745c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db664764-a39e-4a24-b39d-f4e30af8e0ae", "name": "network-vif-deleted", "tag": "c02c72df-11f2-43e9-90cc-22fd0be2f051"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:34:03.658683 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:03.665329 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-ea57406f-c726-445c-bbc1-e884c0058100 req-21337adc-0563-47d5-9daa-83a018c0745c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.666046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-ea57406f-c726-445c-bbc1-e884c0058100 req-21337adc-0563-47d5-9daa-83a018c0745c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.667029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-ea57406f-c726-445c-bbc1-e884c0058100 req-21337adc-0563-47d5-9daa-83a018c0745c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.682519 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-ea57406f-c726-445c-bbc1-e884c0058100 req-21337adc-0563-47d5-9daa-83a018c0745c service nova] Creating event network-vif-deleted:c02c72df-11f2-43e9-90cc-22fd0be2f051 for instance db664764-a39e-4a24-b39d-f4e30af8e0ae on hv-cinder-82099 Sep 19 11:34:03.688684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-ea57406f-c726-445c-bbc1-e884c0058100 req-21337adc-0563-47d5-9daa-83a018c0745c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041186 Sep 19 11:34:03.689299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 441/880] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:04.192777 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:04.194051 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:04.202993 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.203689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.204414 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.205331 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.205947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.206634 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.242874 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.243895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.244556 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.245050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lazy-loading 'fault' on Instance uuid db664764-a39e-4a24-b39d-f4e30af8e0ae {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:34:04.297625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac8337d54a24d0c8fa4c836557bf933', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '914cee0eaeb1460db8b0c068920a962c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:04.306258 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-85f9eb8c-1ff2-4b3d-8704-c8fc0e24ccb1 tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 200 len: 1303 microversion: 2.1 time: 0.120027 Sep 19 11:34:04.306869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 440/881] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:04 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:05.332252 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:05.333300 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] [instance: db664764-a39e-4a24-b39d-f4e30af8e0ae] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:05.339237 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.339732 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.340207 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.340905 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.341373 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.341804 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.355046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] HTTP exception thrown: Instance db664764-a39e-4a24-b39d-f4e30af8e0ae could not be found. Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Request method failure captured: Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae HTTP/1.1 Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFOLTq41z0R9MDh4FoOTYFC1DdaYbFJp-32fFOAoxjfYsQZQZrh4O5njJCIdeYrwEhyYr97T6LP3rcmUEj_lFw2ef7_BFr2inh0ZJiproMyIsuSBgrmzCHz86qSdQ0MpSkaWG5Rh1VQS6hVjSA5k020TrIIC7gZTZ73aJ1N3K10c3Ao Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 914cee0eaeb1460db8b0c068920a962c Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesActionsTest-395534218 Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:34:05.356755 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_914cee0eaeb1460db8b0c068920a962c", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/914cee0eaeb1460db8b0c068920a962c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/914cee0eaeb1460db8b0c068920a962c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/914cee0eaeb1460db8b0c068920a962c"}]}] Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesActionsTest-395534218 Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 914cee0eaeb1460db8b0c068920a962c Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesActionsTest-395534218 Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesActionsTest-395534218-project Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: cac8337d54a24d0c8fa4c836557bf933 Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesActionsTest-395534218-project Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance db664764-a39e-4a24-b39d-f4e30af8e0ae could not be found. Sep 19 11:34:05.358409 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': 'db664764-a39e-4a24-b39d-f4e30af8e0ae'} Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db664764-a39e-4a24-b39d-f4e30af8e0ae could not be found. Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:34:05.364283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db664764-a39e-4a24-b39d-f4e30af8e0ae could not be found. Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db664764-a39e-4a24-b39d-f4e30af8e0ae could not be found. Sep 19 11:34:05.365666 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:34:05.366790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] Returning 404 to user: Instance db664764-a39e-4a24-b39d-f4e30af8e0ae could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:34:05.366790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-971d4868-434c-44e6-9f4b-073e46f21e7b tempest-VolumesActionsTest-395534218 tempest-VolumesActionsTest-395534218-project] 10.222.0.81 "GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae" status: 404 len: 111 microversion: 2.1 time: 0.031826 Sep 19 11:34:05.366790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 442/882] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:05 2022] GET /compute/v2.1/servers/db664764-a39e-4a24-b39d-f4e30af8e0ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:35:16.557370 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=5 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:16.558114 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:16.562527 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-903088330", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "networks": [{"uuid": "1b01e7ac-d7d6-4058-98be-e14ceb97237a"}]}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:35:16.614814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.network.neutron [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] validate_networks() for [('1b01e7ac-d7d6-4058-98be-e14ceb97237a', None, None, None, None, None)] {{(pid=120458) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:35:17.020542 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Flavor limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:35:17.020964 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Image limits 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:35:17.021438 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Flavor pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:35:17.021846 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Image pref 0:0:0 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:35:17.022255 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.virt.hardware [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120458) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:35:17.032280 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.032761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.033194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.033949 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.034401 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.034826 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.051262 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Getting quotas for project 1b4bae2bd5f34bdc88c81e24590ade57. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:35:17.055626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Getting quotas for user 26a9a15e88a648bb93cfc5c49bd17786 and project 1b4bae2bd5f34bdc88c81e24590ade57. Resources: {'instances', 'ram', 'cores'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:35:17.066406 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Going to run 1 instances... {{(pid=120458) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:35:17.069002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120458) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:35:17.117302 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9e0473fb-5346-4688-872c-531b2ed0aea3 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561101 Sep 19 11:35:17.117963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 441/883] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:35:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:35:17.127314 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:17.128075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=44 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:17.133375 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3a77d3cd-605a-43bc-b719-397e792fb6a9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:17.135348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3a77d3cd-605a-43bc-b719-397e792fb6a9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:17.191564 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3a77d3cd-605a-43bc-b719-397e792fb6a9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:17.199274 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3a77d3cd-605a-43bc-b719-397e792fb6a9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1218 microversion: 2.1 time: 0.074048 Sep 19 11:35:17.199847 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 443/884] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:17 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:18.220990 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:18.221855 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:18.229261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:18.230254 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:18.230702 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.231439 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:18.231921 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:18.232902 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.320327 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:18.331601 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7418aea7-b2a3-4b16-af94-cb227a02a7df tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1278 microversion: 2.1 time: 0.114277 Sep 19 11:35:18.332801 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 442/885] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:18 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:19.357589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:19.358223 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:19.365708 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.366213 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.366659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.367363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.367851 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.368287 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.558109 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:19.565834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-1947dbfe-9867-4dd7-9923-56382ea5a948 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.212096 Sep 19 11:35:19.566407 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 444/886] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:19 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:19.781837 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-1e9e6ae5-c3bd-4fd6-9118-e97771853f1d req-059450db-8bcd-4e97-9887-e79ffb71782e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "961c2f18-9e1f-416b-8bc3-fa6b13a06b80", "tag": "cc24bdab-ddb8-49b4-afe2-ea46ec1f3054"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:35:19.792506 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e9e6ae5-c3bd-4fd6-9118-e97771853f1d req-059450db-8bcd-4e97-9887-e79ffb71782e service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.793085 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e9e6ae5-c3bd-4fd6-9118-e97771853f1d req-059450db-8bcd-4e97-9887-e79ffb71782e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.793587 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-1e9e6ae5-c3bd-4fd6-9118-e97771853f1d req-059450db-8bcd-4e97-9887-e79ffb71782e service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.807368 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-1e9e6ae5-c3bd-4fd6-9118-e97771853f1d req-059450db-8bcd-4e97-9887-e79ffb71782e service nova] Creating event network-changed:cc24bdab-ddb8-49b4-afe2-ea46ec1f3054 for instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 on hv-cinder-82099 Sep 19 11:35:19.812629 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-1e9e6ae5-c3bd-4fd6-9118-e97771853f1d req-059450db-8bcd-4e97-9887-e79ffb71782e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177437 Sep 19 11:35:19.813277 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 443/887] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:20.590033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:20.590641 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:20.597108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.597595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.598037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.598726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.599188 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.599620 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.730072 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:20.737623 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3c70814a-3bce-465c-bec6-50bde9e93607 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.152234 Sep 19 11:35:20.738194 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 445/888] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:20 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:21.760578 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:21.761213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:21.767395 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.767922 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.768366 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.769057 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.769521 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.769947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.901283 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:21.908874 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c859b16d-a1d1-4f3d-b265-545c1c36b985 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.153197 Sep 19 11:35:21.909435 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 444/889] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:21 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:22.931628 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:22.932189 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:22.938606 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.939099 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.939546 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.940278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.940741 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.941175 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.067674 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:23.075921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a9cb38f3-4e4b-452b-96e0-a1a199f3d83e tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.148249 Sep 19 11:35:23.076486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 446/890] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:22 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:24.098002 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:24.098558 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:24.105540 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.106022 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.106458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.107146 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.107599 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.108063 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.236686 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:24.245087 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-fc17df2b-3c1f-4c6b-a90a-15f16f60cb14 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.150978 Sep 19 11:35:24.248269 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 445/891] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:24 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:25.266470 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:25.267006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:25.273442 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.273931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.274365 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.275057 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.275515 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.275975 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.406014 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:25.413553 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a4278962-8976-4e16-a4c1-1142fe5acac9 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.151014 Sep 19 11:35:25.414441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 447/892] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:25 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:25.547323 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-128fa1bb-bb04-48db-9945-8d7924b5b54c req-23a2eb49-46f1-412b-8974-a98cd2765eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961c2f18-9e1f-416b-8bc3-fa6b13a06b80", "name": "network-vif-plugged", "status": "completed", "tag": "cc24bdab-ddb8-49b4-afe2-ea46ec1f3054"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:35:25.557411 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-128fa1bb-bb04-48db-9945-8d7924b5b54c req-23a2eb49-46f1-412b-8974-a98cd2765eb3 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.557894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-128fa1bb-bb04-48db-9945-8d7924b5b54c req-23a2eb49-46f1-412b-8974-a98cd2765eb3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.558350 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-128fa1bb-bb04-48db-9945-8d7924b5b54c req-23a2eb49-46f1-412b-8974-a98cd2765eb3 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.569155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-128fa1bb-bb04-48db-9945-8d7924b5b54c req-23a2eb49-46f1-412b-8974-a98cd2765eb3 service nova] Creating event network-vif-plugged:cc24bdab-ddb8-49b4-afe2-ea46ec1f3054 for instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 on hv-cinder-82099 Sep 19 11:35:25.574422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-128fa1bb-bb04-48db-9945-8d7924b5b54c req-23a2eb49-46f1-412b-8974-a98cd2765eb3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086212 Sep 19 11:35:25.574997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 446/893] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:26.437277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:26.437897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:26.447105 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.447683 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.448160 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.448869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.449334 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.449770 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.582017 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:26.589711 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-05c705f8-6a2e-46f7-a55d-144fe525ab8f tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1318 microversion: 2.1 time: 0.156320 Sep 19 11:35:26.590293 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 448/894] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:26 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:27.610585 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:27.611494 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:27.616790 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:27.617991 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:27.625594 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.626083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.626518 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.627212 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.627676 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.628133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.757228 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:27.764886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3f8ec772-39e3-4c45-924f-83bbdd999a03 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1506 microversion: 2.1 time: 0.155814 Sep 19 11:35:27.765445 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 447/895] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:27 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:41.906700 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fa1653e-9f07-4b0f-a089-e68ef46fef9b", "device": "/dev/sdb"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:35:41.909726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:41.911636 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:41.913173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=14 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:41.913874 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=30 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:41.920089 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.920579 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.921020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.921718 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.922183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.922618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.162360 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8a2463d9-c724-4dd3-be8f-d9ec4fcb182c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "POST /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259539 Sep 19 11:35:42.166290 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 449/896] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:35:41 2022] POST /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:01.689420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:01.689903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:01.692539 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:01.693303 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=30 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:01.700316 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.700833 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.701308 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.702083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.702541 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.702974 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.783848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lazy-loading 'services' on Instance uuid 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:36:01.854126 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-77a6ca55-083f-45a6-994b-d7d5e00d4926 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "DELETE /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80/os-volume_attachments/9fa1653e-9f07-4b0f-a089-e68ef46fef9b" status: 202 len: 0 microversion: 2.1 time: 0.168571 Sep 19 11:36:01.854708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 448/897] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:36:01 2022] DELETE /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80/os-volume_attachments/9fa1653e-9f07-4b0f-a089-e68ef46fef9b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:36:02.974589 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:02.975353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:02.979938 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:02.980526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:02.987662 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.988178 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.988620 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.989310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.989765 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.990193 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.016880 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Going to try to terminate instance {{(pid=120459) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:36:03.090618 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-904307b1-23a4-4e9c-86e3-5811c1258655 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "DELETE /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 204 len: 0 microversion: 2.1 time: 0.117153 Sep 19 11:36:03.091295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 450/898] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:36:02 2022] DELETE /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:36:03.101005 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:03.101701 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:03.108274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.108757 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.109194 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.109877 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.110352 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.110775 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.245055 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:03.252760 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a9bebb5d-4448-4b11-9f01-26930a9bb381 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1512 microversion: 2.1 time: 0.156419 Sep 19 11:36:03.253326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 449/899] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:03 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:04.275854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:04.276594 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:04.282923 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:04.283414 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:04.283897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:04.284652 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:04.285121 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:04.285558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:04.423936 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:04.431693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c874bba1-0c04-429b-a46a-65939d9da26c tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1512 microversion: 2.1 time: 0.160919 Sep 19 11:36:04.432280 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 451/900] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:04 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:05.088375 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-c0b93cfa-12b5-4442-809f-f12cefa3820d req-c271da07-59aa-4a22-a54c-f72d081957ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "961c2f18-9e1f-416b-8bc3-fa6b13a06b80", "name": "network-vif-deleted", "tag": "cc24bdab-ddb8-49b4-afe2-ea46ec1f3054"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:05.098475 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c0b93cfa-12b5-4442-809f-f12cefa3820d req-c271da07-59aa-4a22-a54c-f72d081957ad service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.099010 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c0b93cfa-12b5-4442-809f-f12cefa3820d req-c271da07-59aa-4a22-a54c-f72d081957ad service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.099641 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-c0b93cfa-12b5-4442-809f-f12cefa3820d req-c271da07-59aa-4a22-a54c-f72d081957ad service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.110957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-c0b93cfa-12b5-4442-809f-f12cefa3820d req-c271da07-59aa-4a22-a54c-f72d081957ad service nova] Creating event network-vif-deleted:cc24bdab-ddb8-49b4-afe2-ea46ec1f3054 for instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 on hv-cinder-82099 Sep 19 11:36:05.115787 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-c0b93cfa-12b5-4442-809f-f12cefa3820d req-c271da07-59aa-4a22-a54c-f72d081957ad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031057 Sep 19 11:36:05.116379 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 450/901] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:05.454643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:05.455280 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:05.461833 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.462328 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.462775 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.463614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.464113 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.464551 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.498354 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.498854 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.499310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.499795 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lazy-loading 'fault' on Instance uuid 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:36:05.542380 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:05.550059 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-754c584a-745d-4939-9346-07d4072a789b tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 200 len: 1308 microversion: 2.1 time: 0.100075 Sep 19 11:36:05.551007 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 452/902] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:05 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:06.575108 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:06.575829 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 961c2f18-9e1f-416b-8bc3-fa6b13a06b80] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:06.582062 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.582548 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.582988 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.583681 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.584165 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.584626 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.598130 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.wsgi [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] HTTP exception thrown: Instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 could not be found. Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Request method failure captured: Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: request: GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 HTTP/1.1 Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept: application/json Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Accept-Encoding: identity Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Connection: close Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Length: 0 Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Content-Type: application/json Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Host: 10.222.0.81 Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: Openstack-System-Scope: None Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: User-Agent: python-urllib3/1.26.12 Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Auth-Token: gAAAAABjKFPzzim9CC2G4hI5wSDtPkM5EZNjGOm10legVDbPEUm5SliZ1Tsw58TF38fs_nyhVvQIiRTwnL6bVUMwjuLptH61L2tIOjWmnzUuuryMxjRhwrclmhVxjbHmNGaFcLnBs52htwsNb-RaJnJmvYShowsHAohCSGWnrG7LzyK_7ZAVFDg Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Id: None Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Domain-Name: None Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Identity-Status: Confirmed Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Is-Admin-Project: True Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Id: default Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Domain-Name: Default Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Id: 1b4bae2bd5f34bdc88c81e24590ade57 Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1648817076 Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Role: reader,member Sep 19 11:36:06.599724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Roles: reader,member Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1b4bae2bd5f34bdc88c81e24590ade57", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1b4bae2bd5f34bdc88c81e24590ade57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1b4bae2bd5f34bdc88c81e24590ade57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1b4bae2bd5f34bdc88c81e24590ade57"}]}] Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant: tempest-VolumesSnapshotTestJSON-1648817076 Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Id: 1b4bae2bd5f34bdc88c81e24590ade57 Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1648817076 Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User: tempest-VolumesSnapshotTestJSON-1648817076-project Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Id: default Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Domain-Name: Default Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Id: 26a9a15e88a648bb93cfc5c49bd17786 Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: X-User-Name: tempest-VolumesSnapshotTestJSON-1648817076-project Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: method: > Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: exception: Instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 could not be found. Sep 19 11:36:06.601405 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: action_args: {'id': '961c2f18-9e1f-416b-8bc3-fa6b13a06b80'} Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 could not be found. Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:36:06.602417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 could not be found. Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 could not be found. Sep 19 11:36:06.604463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR nova.api.openstack.wsgi Sep 19 11:36:06.605679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Returning 404 to user: Instance 961c2f18-9e1f-416b-8bc3-fa6b13a06b80 could not be found. {{(pid=120458) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:36:06.605679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6d2c10e9-647a-4e42-aa87-bc09315c0dd5 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80" status: 404 len: 111 microversion: 2.1 time: 0.030784 Sep 19 11:36:06.605679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 451/903] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:06 2022] GET /compute/v2.1/servers/961c2f18-9e1f-416b-8bc3-fa6b13a06b80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:36:14.382053 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-36491114", "imageRef": "1038c65b-1af9-46e7-bcf2-9584f25a83c8", "flavorRef": "452", "networks": [{"uuid": "1b01e7ac-d7d6-4058-98be-e14ceb97237a"}]}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:14.435419 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] validate_networks() for [('1b01e7ac-d7d6-4058-98be-e14ceb97237a', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:36:14.817749 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:36:14.818177 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:36:14.818655 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:36:14.819069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:36:14.819484 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:36:14.830798 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:14.831278 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:14.833098 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:14.833856 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:14.834324 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:14.834757 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:14.863214 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Getting quotas for project 1b4bae2bd5f34bdc88c81e24590ade57. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:36:14.868462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Getting quotas for user 26a9a15e88a648bb93cfc5c49bd17786 and project 1b4bae2bd5f34bdc88c81e24590ade57. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:36:14.879945 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:36:14.882247 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1038c65b-1af9-46e7-bcf2-9584f25a83c8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:36:14.928024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-cb13a414-c3c0-489d-ad27-cd1c0aae5e58 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549726 Sep 19 11:36:14.928931 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 453/904] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:36:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:36:14.940761 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c2bd907f-a65a-410d-97fc-51695e72b956 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:14.941381 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c2bd907f-a65a-410d-97fc-51695e72b956 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:14.996896 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-c2bd907f-a65a-410d-97fc-51695e72b956 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:15.003738 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c2bd907f-a65a-410d-97fc-51695e72b956 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1217 microversion: 2.1 time: 0.067035 Sep 19 11:36:15.004337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 452/905] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:14 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:16.026607 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:16.027268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:16.033858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:16.034352 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:16.034786 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:16.035473 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:16.035960 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:16.036388 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:16.110897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:16.118480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f50fd427-3bd3-4ad9-9d22-847729737257 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1275 microversion: 2.1 time: 0.096384 Sep 19 11:36:16.119050 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 454/906] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:16 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:17.142625 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:17.143173 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:17.145678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:17.152230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:17.152720 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:17.153180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:17.153909 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:17.154482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:17.154750 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:17.175794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-3e5adcbd-50d1-476d-be42-9bba57be6541 req-876499c6-6366-4c03-8991-48fba798014c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "696f7b11-0227-4495-aad3-f6d024161c61", "tag": "1b4a9c8d-3bda-40e0-bbda-eeb024ad4e7a"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:17.190204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3e5adcbd-50d1-476d-be42-9bba57be6541 req-876499c6-6366-4c03-8991-48fba798014c service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:17.190812 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3e5adcbd-50d1-476d-be42-9bba57be6541 req-876499c6-6366-4c03-8991-48fba798014c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:17.191310 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-3e5adcbd-50d1-476d-be42-9bba57be6541 req-876499c6-6366-4c03-8991-48fba798014c service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:17.203271 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-3e5adcbd-50d1-476d-be42-9bba57be6541 req-876499c6-6366-4c03-8991-48fba798014c service nova] Creating event network-changed:1b4a9c8d-3bda-40e0-bbda-eeb024ad4e7a for instance 696f7b11-0227-4495-aad3-f6d024161c61 on hv-cinder-82099 Sep 19 11:36:17.209126 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-3e5adcbd-50d1-476d-be42-9bba57be6541 req-876499c6-6366-4c03-8991-48fba798014c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042397 Sep 19 11:36:17.209722 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 455/907] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:17.403123 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:17.410758 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-30a450e8-2a1b-4871-986f-b44d480cda0d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1317 microversion: 2.1 time: 0.272225 Sep 19 11:36:17.411329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 453/908] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:17 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:18.434870 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:18.435646 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:18.442129 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:18.442622 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:18.443068 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:18.443793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:18.444260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:18.444691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:18.647817 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:18.655730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f2bc57e9-e870-4aa0-94b8-30874eaf16e6 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1317 microversion: 2.1 time: 0.226026 Sep 19 11:36:18.656532 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 456/909] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:18 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:19.678607 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:19.679230 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:19.685718 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:19.686211 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:19.686656 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:19.687359 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:19.687841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:19.688292 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:19.820148 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:19.828426 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7040f504-84d6-480b-abab-6f60e4a428da tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1317 microversion: 2.1 time: 0.153677 Sep 19 11:36:19.828995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 454/910] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:19 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:20.850661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:20.851284 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:20.857875 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:20.858363 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:20.858810 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:20.859507 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:20.859997 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:20.860434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:20.987173 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:21.000493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2beb936e-85ab-4711-9a55-9e33708d0219 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1317 microversion: 2.1 time: 0.153645 Sep 19 11:36:21.001091 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 457/911] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:20 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:21.789793 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-db951742-5072-43e0-ba57-055977d1f165 req-02d0502a-99dd-4811-9d6a-18bc8c6663e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696f7b11-0227-4495-aad3-f6d024161c61", "name": "network-vif-plugged", "status": "completed", "tag": "1b4a9c8d-3bda-40e0-bbda-eeb024ad4e7a"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:21.799250 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-db951742-5072-43e0-ba57-055977d1f165 req-02d0502a-99dd-4811-9d6a-18bc8c6663e1 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:21.799745 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-db951742-5072-43e0-ba57-055977d1f165 req-02d0502a-99dd-4811-9d6a-18bc8c6663e1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:21.800239 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-db951742-5072-43e0-ba57-055977d1f165 req-02d0502a-99dd-4811-9d6a-18bc8c6663e1 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:21.811373 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-db951742-5072-43e0-ba57-055977d1f165 req-02d0502a-99dd-4811-9d6a-18bc8c6663e1 service nova] Creating event network-vif-plugged:1b4a9c8d-3bda-40e0-bbda-eeb024ad4e7a for instance 696f7b11-0227-4495-aad3-f6d024161c61 on hv-cinder-82099 Sep 19 11:36:21.816770 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-db951742-5072-43e0-ba57-055977d1f165 req-02d0502a-99dd-4811-9d6a-18bc8c6663e1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030825 Sep 19 11:36:21.817356 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 455/912] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:22.022595 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:22.023299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:22.030624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:22.031115 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:22.031562 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:22.032299 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:22.032758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:22.033191 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:22.161220 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:22.169434 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-9a3eb02e-9c6c-4d27-bc92-91674b954343 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1317 microversion: 2.1 time: 0.150867 Sep 19 11:36:22.170006 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 458/913] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:22 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:23.192557 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:23.193261 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:23.199353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:23.199871 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:23.200312 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:23.200997 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:23.201453 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:23.201880 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:23.334304 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:23.342030 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-76a537b9-e405-4702-a20d-1d42a676782a tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1317 microversion: 2.1 time: 0.154442 Sep 19 11:36:23.342813 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 456/914] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:23 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:24.364447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:24.365069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:24.372010 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:24.372497 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:24.372937 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:24.373632 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:24.374090 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:24.374518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:24.506471 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:24.514730 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-670a8284-8df7-42dc-9ff3-49420fe1692d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1506 microversion: 2.1 time: 0.154166 Sep 19 11:36:24.515295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 459/915] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:24 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:24.536557 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24028011-40a4-41c4-b858-354e15569330", "device": "/dev/sdb"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:24.539428 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:24.545814 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:24.546298 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:24.546736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:24.547425 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:24.547914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:24.548343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:24.782891 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-78e7333f-f8ca-468c-aa41-21aeda3dd29d tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "POST /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250229 Sep 19 11:36:24.783495 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 457/916] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:36:24 2022] POST /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:41.016443 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:41.016987 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:41.018928 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:41.019568 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:41.020684 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:41.021180 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:41.028053 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:41.028538 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:41.028975 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:41.029665 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:41.030171 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:41.030591 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:41.113574 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.objects.instance [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lazy-loading 'services' on Instance uuid 696f7b11-0227-4495-aad3-f6d024161c61 {{(pid=120459) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:36:41.185478 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-6bc4fb9c-0fe0-4b54-b63c-ae4e2bad8287 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "DELETE /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61/os-volume_attachments/24028011-40a4-41c4-b858-354e15569330" status: 202 len: 0 microversion: 2.1 time: 0.173679 Sep 19 11:36:41.186066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 460/917] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:36:41 2022] DELETE /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61/os-volume_attachments/24028011-40a4-41c4-b858-354e15569330 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:36:42.309434 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=2 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:42.310274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=22 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:42.310922 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:42.315203 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:42.315811 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:42.324243 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:42.324736 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:42.325178 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:42.325876 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:42.326338 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:42.326780 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:42.354182 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:36:42.428573 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-ef0bed53-9986-493d-a9e1-24a8d91f2167 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "DELETE /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 204 len: 0 microversion: 2.1 time: 0.120343 Sep 19 11:36:42.429147 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 458/918] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:36:42 2022] DELETE /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:36:42.439322 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:42.440069 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:42.446764 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:42.447270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:42.447697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:42.449054 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:42.449522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:42.449957 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:42.578834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:42.587111 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-cd08fac1-5c4f-48d3-9cb2-4dd70686fbed tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1512 microversion: 2.1 time: 0.152362 Sep 19 11:36:42.587675 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 461/919] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:42 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:36:43.610222 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:43.612260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:43.617783 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:43.618853 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:43.619295 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:43.621151 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:43.623057 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:43.623507 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:43.755197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:43.763013 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9990a382-3d31-43e7-8974-ac2cee1ce863 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1512 microversion: 2.1 time: 0.157026 Sep 19 11:36:43.763580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 459/920] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:43 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:44.625819 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-f478678b-9a0e-4eb7-9f77-18242056cce2 req-a2ccf437-3a67-4bbe-8056-4f9cafb23f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "696f7b11-0227-4495-aad3-f6d024161c61", "name": "network-vif-deleted", "tag": "1b4a9c8d-3bda-40e0-bbda-eeb024ad4e7a"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:44.640459 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f478678b-9a0e-4eb7-9f77-18242056cce2 req-a2ccf437-3a67-4bbe-8056-4f9cafb23f12 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:44.641253 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f478678b-9a0e-4eb7-9f77-18242056cce2 req-a2ccf437-3a67-4bbe-8056-4f9cafb23f12 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:44.641885 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f478678b-9a0e-4eb7-9f77-18242056cce2 req-a2ccf437-3a67-4bbe-8056-4f9cafb23f12 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:44.655916 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-f478678b-9a0e-4eb7-9f77-18242056cce2 req-a2ccf437-3a67-4bbe-8056-4f9cafb23f12 service nova] Creating event network-vif-deleted:1b4a9c8d-3bda-40e0-bbda-eeb024ad4e7a for instance 696f7b11-0227-4495-aad3-f6d024161c61 on hv-cinder-82099 Sep 19 11:36:44.661020 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-f478678b-9a0e-4eb7-9f77-18242056cce2 req-a2ccf437-3a67-4bbe-8056-4f9cafb23f12 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038904 Sep 19 11:36:44.661624 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 462/921] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:36:44.786155 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:44.786845 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:44.793338 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:44.793826 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:44.794267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:44.794962 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:44.795423 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:44.795884 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:44.827483 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:44.828016 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:44.828463 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:44.828921 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lazy-loading 'fault' on Instance uuid 696f7b11-0227-4495-aad3-f6d024161c61 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:36:44.869073 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a9a15e88a648bb93cfc5c49bd17786', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4bae2bd5f34bdc88c81e24590ade57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:44.876739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-a79d077d-6464-4cf8-a627-ca9a7201aa09 tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 200 len: 1307 microversion: 2.1 time: 0.094576 Sep 19 11:36:44.877304 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 460/922] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:44 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:45.901261 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:45.901966 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] [instance: 696f7b11-0227-4495-aad3-f6d024161c61] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:45.908696 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:45.909127 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:45.909573 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:45.910266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:45.910729 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:45.911166 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:45.924280 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] HTTP exception thrown: Instance 696f7b11-0227-4495-aad3-f6d024161c61 could not be found. Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Request method failure captured: Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 HTTP/1.1 Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFPzzim9CC2G4hI5wSDtPkM5EZNjGOm10legVDbPEUm5SliZ1Tsw58TF38fs_nyhVvQIiRTwnL6bVUMwjuLptH61L2tIOjWmnzUuuryMxjRhwrclmhVxjbHmNGaFcLnBs52htwsNb-RaJnJmvYShowsHAohCSGWnrG7LzyK_7ZAVFDg Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 1b4bae2bd5f34bdc88c81e24590ade57 Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1648817076 Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:36:45.925911 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_1b4bae2bd5f34bdc88c81e24590ade57", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/1b4bae2bd5f34bdc88c81e24590ade57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1b4bae2bd5f34bdc88c81e24590ade57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/1b4bae2bd5f34bdc88c81e24590ade57"}]}] Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-VolumesSnapshotTestJSON-1648817076 Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 1b4bae2bd5f34bdc88c81e24590ade57 Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1648817076 Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-VolumesSnapshotTestJSON-1648817076-project Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 26a9a15e88a648bb93cfc5c49bd17786 Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-VolumesSnapshotTestJSON-1648817076-project Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 696f7b11-0227-4495-aad3-f6d024161c61 could not be found. Sep 19 11:36:45.927529 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '696f7b11-0227-4495-aad3-f6d024161c61'} Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 696f7b11-0227-4495-aad3-f6d024161c61 could not be found. Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:36:45.928745 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 696f7b11-0227-4495-aad3-f6d024161c61 could not be found. Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 696f7b11-0227-4495-aad3-f6d024161c61 could not be found. Sep 19 11:36:45.930309 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:36:45.931739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] Returning 404 to user: Instance 696f7b11-0227-4495-aad3-f6d024161c61 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:36:45.931739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-609371af-4c58-424d-82e8-f3ac4f8295ac tempest-VolumesSnapshotTestJSON-1648817076 tempest-VolumesSnapshotTestJSON-1648817076-project] 10.222.0.81 "GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61" status: 404 len: 111 microversion: 2.1 time: 0.030853 Sep 19 11:36:45.931739 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 463/923] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:45 2022] GET /compute/v2.1/servers/696f7b11-0227-4495-aad3-f6d024161c61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:37:26.978225 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-912f442f-5998-432c-b0d1-d4bd15084f33 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Action: 'create', calling method: .version_select at 0x7ff5214ed940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1275017677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKb31WGG6PA6dTU3xV8jyHlg7jYKHZXcbZvJUirMakbcOKDI2EmvD6LjVzCCRmyFwG3zPwp2PWae6QTMq/D5JrAT7i1V3+Mly8crgz3d2uhogrtpf+WZu6KPmtjnpD8zzw=="}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:26.983947 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:26.984708 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:26.999679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-912f442f-5998-432c-b0d1-d4bd15084f33 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Getting quotas for project 67f0a300a82b480d8f4a2c0a19f94fb6. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:37:27.003482 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.quota [None req-912f442f-5998-432c-b0d1-d4bd15084f33 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Getting quotas for user 1d4fe64743d747ccadb431ce88fbadcb and project 67f0a300a82b480d8f4a2c0a19f94fb6. Resources: {'key_pairs'} {{(pid=120458) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:37:27.015058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: ERROR oslo.messaging._drivers.impl_rabbit [None req-912f442f-5998-432c-b0d1-d4bd15084f33 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [5cd855bb-84ea-415b-b321-e7a42fed81b8] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 11:37:28.023209 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO oslo.messaging._drivers.impl_rabbit [None req-912f442f-5998-432c-b0d1-d4bd15084f33 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [5cd855bb-84ea-415b-b321-e7a42fed81b8] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 34330. Sep 19 11:37:28.038132 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-912f442f-5998-432c-b0d1-d4bd15084f33 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.064296 Sep 19 11:37:28.038743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 461/924] 10.222.0.81 () {60 vars in 1159 bytes} [Mon Sep 19 11:37:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:28.090474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2048575862", "imageRef": "9307c7e0-88f4-42c4-ae0a-c532fc8ec4ab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1275017677", "networks": [{"uuid": "19767917-7d2c-41bc-91d4-fa9f38d3bc1f"}]}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:28.104053 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=8 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:28.104703 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:28.155736 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.network.neutron [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] validate_networks() for [('19767917-7d2c-41bc-91d4-fa9f38d3bc1f', None, None, None, None, None)] {{(pid=120459) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:37:28.527199 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Flavor limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:37:28.527796 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Image limits 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:37:28.528291 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Flavor pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:37:28.528704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Image pref 0:0:0 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:37:28.529119 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.virt.hardware [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120459) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:37:28.538303 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:28.538793 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:28.539235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:28.540022 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:28.540480 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:28.540912 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:28.557610 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Getting quotas for project 67f0a300a82b480d8f4a2c0a19f94fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:37:28.561659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.quota [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Getting quotas for user 1d4fe64743d747ccadb431ce88fbadcb and project 67f0a300a82b480d8f4a2c0a19f94fb6. Resources: {'instances', 'ram', 'cores'} {{(pid=120459) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:37:28.573441 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Going to run 1 instances... {{(pid=120459) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:37:28.575679 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9307c7e0-88f4-42c4-ae0a-c532fc8ec4ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120459) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:37:28.622685 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-47f4594c-91ad-484e-bc73-3de35357783b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536226 Sep 19 11:37:28.623340 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 464/925] 10.222.0.81 () {60 vars in 1147 bytes} [Mon Sep 19 11:37:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:37:28.635183 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-259265c2-6c0e-4fa2-a970-77e2b13d1298 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:28.635815 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-259265c2-6c0e-4fa2-a970-77e2b13d1298 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:28.694444 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-259265c2-6c0e-4fa2-a970-77e2b13d1298 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:28.701848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-259265c2-6c0e-4fa2-a970-77e2b13d1298 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1259 microversion: 2.1 time: 0.071476 Sep 19 11:37:28.702420 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 462/926] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:28 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:29.725400 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:29.726026 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:29.733332 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:29.733834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:29.734275 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:29.735103 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:29.735571 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:29.736030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:29.813095 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:29.822715 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-a2b67671-f5be-4397-ae61-8a30066d380a tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1317 microversion: 2.1 time: 0.101767 Sep 19 11:37:29.823402 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 465/927] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:29 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:37:30.846210 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:30.846878 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:30.853953 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:30.854450 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:30.854893 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:30.855612 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:30.856268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:30.856703 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:30.993605 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:31.001653 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-72754d33-1b27-464f-b618-429ce2e7763d tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.159406 Sep 19 11:37:31.016101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 463/928] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:30 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:32.025526 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:32.026096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:32.033968 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:32.034806 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:32.035235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:32.035983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:32.036450 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:32.036882 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:32.183674 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:32.192422 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-89ab912d-1418-4995-b8c5-989f55140074 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.170783 Sep 19 11:37:32.193046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 466/929] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:32 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:33.214898 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:33.215520 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:33.222255 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:33.222747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:33.223188 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:33.224456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:33.224913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:33.225343 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:33.359931 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:33.368923 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-10420ff1-b65a-4e0b-8758-bb5043a45b97 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.157779 Sep 19 11:37:33.369808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 464/930] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:33 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:34.391486 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:34.392170 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:34.399549 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:34.400067 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:34.400558 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:34.401405 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:34.401894 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:34.402794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:34.557597 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:34.566128 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-45593266-249f-42a5-9b68-9e4859eca9b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.178417 Sep 19 11:37:34.576453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 467/931] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:34 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:35.592289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:35.593344 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:35.600705 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:35.601197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:35.601633 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:35.602329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:35.602782 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:35.603205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:35.764545 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:35.773611 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-db707ed9-a37b-4836-b07a-425ba3e1eeff tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.186362 Sep 19 11:37:35.774484 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 465/932] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:35 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:36.796437 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:36.797085 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:36.803295 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:36.803821 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:36.804277 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:36.805046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:36.805517 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:36.805954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:36.944025 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:36.951965 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-4041647c-5271-4908-a5cb-87c29e02ba86 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.159588 Sep 19 11:37:36.952598 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 468/933] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:36 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:37.974618 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:37.975236 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:37.981928 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:37.982419 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:37.982862 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:37.983553 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:37.984074 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:37.984543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:38.188439 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:38.196200 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-bce37727-9ba8-4ed4-bc18-407f51d55265 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.225541 Sep 19 11:37:38.196774 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 466/934] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:37 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:38.736234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-f9a262b1-3251-4f43-abb4-5e274cdd7cb3 req-91e133e9-6e0b-420b-ad49-29b7aac31cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:38.742996 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:38.743780 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=6 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:38.747734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f9a262b1-3251-4f43-abb4-5e274cdd7cb3 req-91e133e9-6e0b-420b-ad49-29b7aac31cec service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:38.748465 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f9a262b1-3251-4f43-abb4-5e274cdd7cb3 req-91e133e9-6e0b-420b-ad49-29b7aac31cec service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:38.749334 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-f9a262b1-3251-4f43-abb4-5e274cdd7cb3 req-91e133e9-6e0b-420b-ad49-29b7aac31cec service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:38.764241 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-f9a262b1-3251-4f43-abb4-5e274cdd7cb3 req-91e133e9-6e0b-420b-ad49-29b7aac31cec service nova] Creating event network-changed:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:37:38.769219 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-f9a262b1-3251-4f43-abb4-5e274cdd7cb3 req-91e133e9-6e0b-420b-ad49-29b7aac31cec service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036713 Sep 19 11:37:38.769822 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 469/935] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:39.218029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:39.218648 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:39.220516 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell0:SELECT=6 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:39.226080 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:39.226569 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:39.227008 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:39.227696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:39.228181 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:39.228611 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:39.358062 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:39.366256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3a4edab0-0119-4c4a-91b2-1be68f6f5b0c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.152189 Sep 19 11:37:39.366817 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 467/936] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:39 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:40.390169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:40.390866 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:40.397474 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:40.397954 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:40.398389 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:40.399066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:40.399534 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:40.399980 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:40.530794 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:40.538420 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-83d7c666-0803-416f-a91e-ac1c8d321220 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.152972 Sep 19 11:37:40.538973 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 470/937] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:40 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:41.561296 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:41.562192 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:41.569149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:41.569639 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:41.570083 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:41.570772 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:41.571232 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:41.571660 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:41.696976 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:41.705417 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2ead0d74-8744-498e-b973-cacecfc13fbd tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.148018 Sep 19 11:37:41.706004 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 468/938] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:41 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:42.727863 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:42.728488 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:42.734909 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:42.735399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:42.735873 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:42.736567 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:42.737029 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:42.737464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:43.111391 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:43.120283 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-ce16e709-c72b-4870-bb5e-9f2a64b33eec tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.395919 Sep 19 11:37:43.120629 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 471/939] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:42 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:44.143679 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:44.144326 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:44.151324 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:44.151894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:44.152272 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:44.152959 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:44.153414 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:44.153839 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:44.278931 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:44.286511 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-3d8ddfdd-f42d-4e1e-8b89-27671cc484d8 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.147512 Sep 19 11:37:44.287077 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 469/940] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:44 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:44.478422 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-34482b82-7752-4fc4-87d3-bd37aa5f9105 req-e245fd1f-4d2f-417c-8f19-1fd2dd7cee72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "name": "network-vif-plugged", "status": "completed", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:44.488758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-34482b82-7752-4fc4-87d3-bd37aa5f9105 req-e245fd1f-4d2f-417c-8f19-1fd2dd7cee72 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:44.489245 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-34482b82-7752-4fc4-87d3-bd37aa5f9105 req-e245fd1f-4d2f-417c-8f19-1fd2dd7cee72 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:44.489672 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-34482b82-7752-4fc4-87d3-bd37aa5f9105 req-e245fd1f-4d2f-417c-8f19-1fd2dd7cee72 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:44.500770 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-34482b82-7752-4fc4-87d3-bd37aa5f9105 req-e245fd1f-4d2f-417c-8f19-1fd2dd7cee72 service nova] Creating event network-vif-plugged:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:37:44.506399 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-34482b82-7752-4fc4-87d3-bd37aa5f9105 req-e245fd1f-4d2f-417c-8f19-1fd2dd7cee72 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031678 Sep 19 11:37:44.506987 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 472/941] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:45.309259 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:45.309873 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:45.316554 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:45.317029 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:45.317472 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:45.318162 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:45.318622 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:45.319046 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:45.445530 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:45.453289 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-97d7cb6d-3578-4c40-b19d-e3f7570eefe2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1359 microversion: 2.1 time: 0.148005 Sep 19 11:37:45.453863 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 470/942] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:45 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:46.481592 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:46.482298 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:46.488557 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:46.489637 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:46.490076 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:46.490769 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:46.491229 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:46.491659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:46.620555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:46.628174 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-29d0800b-4538-41b0-9fb2-349219b09f35 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1549 microversion: 2.1 time: 0.151337 Sep 19 11:37:46.628734 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 473/943] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:46 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:46.649409 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:46.650015 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:46.656382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:46.656860 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:46.657292 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:46.657975 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:46.658429 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:46.658849 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:46.784089 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:46.792237 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b820eb90-290e-4722-a1bc-b3925cba146f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1549 microversion: 2.1 time: 0.146605 Sep 19 11:37:46.792795 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 471/944] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:46 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:46.814908 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:46.820344 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:46.821111 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Searching by: {'deleted': False, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6'} {{(pid=120459) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 11:37:46.828075 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:46.828554 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:46.828991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:46.829773 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:46.830228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:46.830653 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:46.921321 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.multi_cell_list [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120459) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 11:37:47.011213 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-10b64219-d143-49b7-ad06-569f7b528ca1 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200858 Sep 19 11:37:47.011816 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 474/945] 10.222.0.81 () {58 vars in 1125 bytes} [Mon Sep 19 11:37:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:47.024116 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:47.025354 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:47.031299 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:47.031819 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:47.032268 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:47.032963 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:47.033422 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:47.033851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:47.158565 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:47.166869 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8e3d211f-61f4-439f-9b6b-c0438150e933 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1549 microversion: 2.1 time: 0.147301 Sep 19 11:37:47.167436 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 472/946] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:47 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:48.700661 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77"}} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:48.702994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:48.709404 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:48.709897 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:48.710338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:48.711033 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:48.711490 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:48.711962 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:48.944709 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-346688a5-d073-4ea6-a72b-d872a14c4847 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247904 Sep 19 11:37:48.945481 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 475/947] 10.222.0.81 () {60 vars in 1323 bytes} [Mon Sep 19 11:37:48 2022] POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:55.468458 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:55.469101 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:55.475105 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:55.475593 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:55.476069 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:55.476755 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:55.477213 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:55.477640 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:55.609479 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:55.618886 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-6eb98d76-0f52-49fd-885a-ab78f09ce87c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1595 microversion: 2.1 time: 0.154443 Sep 19 11:37:55.619461 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 473/948] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:55 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:57.260118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell0:SELECT=2 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:57.389272 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-16b42496-07bc-463f-8f0c-39e539ccce23 req-f31db5b6-79c0-49b1-8567-ae9a894c9894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:57.412801 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-16b42496-07bc-463f-8f0c-39e539ccce23 req-f31db5b6-79c0-49b1-8567-ae9a894c9894 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:57.413921 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-16b42496-07bc-463f-8f0c-39e539ccce23 req-f31db5b6-79c0-49b1-8567-ae9a894c9894 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:57.414509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-16b42496-07bc-463f-8f0c-39e539ccce23 req-f31db5b6-79c0-49b1-8567-ae9a894c9894 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:57.426758 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-16b42496-07bc-463f-8f0c-39e539ccce23 req-f31db5b6-79c0-49b1-8567-ae9a894c9894 service nova] Creating event network-changed:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:37:57.432726 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-16b42496-07bc-463f-8f0c-39e539ccce23 req-f31db5b6-79c0-49b1-8567-ae9a894c9894 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180004 Sep 19 11:37:57.433619 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 476/949] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:58.248260 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-574276477"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:58.248791 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:58.251153 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:58.257440 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:58.257937 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:58.258383 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:58.259086 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:58.259577 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:58.260060 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:58.264665 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=67 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:58.403956 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.network.security_group_api [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Adding security group f09da9df-0269-46de-97c5-960e740362ca to port bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 Sep 19 11:37:58.715717 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-5f1fb1a7-bbb5-4dbe-b4db-c9596355329c tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/action" status: 202 len: 0 microversion: 2.1 time: 0.471310 Sep 19 11:37:58.719662 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 474/950] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:37:58 2022] POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:37:58.724615 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [req-0210cf45-b14f-45fa-a9a7-e6d7d9e845c1 req-d7eb4493-fc15-405c-bc32-f62bdc4c8db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:37:58.725783 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:58.726493 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:58.728461 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:58.736059 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-0210cf45-b14f-45fa-a9a7-e6d7d9e845c1 req-d7eb4493-fc15-405c-bc32-f62bdc4c8db9 service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:58.736810 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-0210cf45-b14f-45fa-a9a7-e6d7d9e845c1 req-d7eb4493-fc15-405c-bc32-f62bdc4c8db9 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:58.737586 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [req-0210cf45-b14f-45fa-a9a7-e6d7d9e845c1 req-d7eb4493-fc15-405c-bc32-f62bdc4c8db9 service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:58.745716 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:58.746224 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:58.746659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:58.747396 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:58.747877 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:58.748447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:58.753167 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:58.757256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.compute.server_external_events [req-0210cf45-b14f-45fa-a9a7-e6d7d9e845c1 req-d7eb4493-fc15-405c-bc32-f62bdc4c8db9 service nova] Creating event network-changed:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:37:58.762766 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [req-0210cf45-b14f-45fa-a9a7-e6d7d9e845c1 req-d7eb4493-fc15-405c-bc32-f62bdc4c8db9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041678 Sep 19 11:37:58.763894 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 475/951] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:37:59.032198 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:59.040466 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-8c0eb825-6966-4249-8d59-e456aa08e71f tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1759 microversion: 2.1 time: 0.319300 Sep 19 11:37:59.041660 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 477/952] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:58 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1759 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:21.685932 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:38:21.688276 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:21.690543 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=3 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:21.691186 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=5 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:21.697743 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:21.698227 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:21.698661 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:21.699349 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:21.699828 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:21.700256 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:21.771249 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-784eda8b-cbc3-4af5-b5cc-a7e34a6cd5b5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/action" status: 202 len: 0 microversion: 2.1 time: 0.089027 Sep 19 11:38:21.771895 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 476/953] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:38:21 2022] POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:38:21.780037 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:21.780690 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:21.783034 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=1 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:21.783848 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=5 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:21.789777 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:21.790275 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:21.790791 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:21.791450 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:21.792066 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:21.792502 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:22.020899 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:22.029139 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-f25bc3fb-1ef0-4400-afa4-32444beb2fc5 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1751 microversion: 2.1 time: 0.253054 Sep 19 11:38:22.029692 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 478/954] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:21 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:23.052367 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:23.052995 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:23.059979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:23.060752 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:23.061187 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:23.061875 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:23.062329 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:23.062758 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:23.205523 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:23.215663 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-9f55b756-daf1-4d7b-ba27-1eaf98466935 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.167611 Sep 19 11:38:23.216262 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 477/955] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:23 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:24.238555 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:24.239240 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:24.245678 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:24.246169 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:24.246614 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:24.247308 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:24.247790 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:24.248235 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:24.390120 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:24.404447 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-2bd4f99e-df4d-4430-9a8b-2d035095b973 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.169674 Sep 19 11:38:24.405027 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 479/956] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:24 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:25.427374 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:25.428003 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:25.436274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:25.436751 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:25.437181 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:25.437863 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:25.438337 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:25.438763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:25.583982 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:25.592172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-869d2519-e9e2-426f-91ff-ae6cd91eb8d9 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.168631 Sep 19 11:38:25.592741 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 478/957] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:25 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:26.615393 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:26.616019 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:26.622382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:26.622869 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:26.623307 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:26.624018 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:26.624478 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:26.624906 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:26.769225 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:26.778204 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-e87d3a79-af3a-439f-9978-d1e3a818435b tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.167102 Sep 19 11:38:26.778972 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 480/958] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:26 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:27.801157 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:27.801781 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:27.808353 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:27.808843 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:27.809282 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:27.809973 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:27.810689 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:27.811125 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:27.953515 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:27.962274 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-80ce380b-0416-482b-a780-9dc6ae792d61 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.164982 Sep 19 11:38:27.962851 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 479/959] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:27 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:28.985348 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:28.985956 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:28.992789 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:28.993270 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:28.993702 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:28.994382 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:28.994834 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:28.995257 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:29.133808 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:29.142076 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-bb72899b-cb19-41ed-b644-66c0b9b992a6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.160548 Sep 19 11:38:29.142638 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 481/960] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:28 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:30.164709 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:30.165325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:30.171903 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:30.172397 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:30.172841 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:30.173573 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:30.174033 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:30.174468 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:30.315603 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:30.323788 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-37ce5dea-8f2b-45a4-9ad5-dc35cbe49cce tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.163523 Sep 19 11:38:30.324357 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 480/961] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:30 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:31.347132 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:31.347704 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:31.354697 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:31.355183 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:31.355621 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:31.356345 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:31.356803 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:31.357228 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:31.498872 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:31.507457 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-62efb2c2-0f19-4488-b3fc-1390616db797 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.164303 Sep 19 11:38:31.508053 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 482/962] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:31 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:32.530446 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:32.531050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:32.538185 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:32.538678 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:32.539121 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:32.539832 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:32.540297 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:32.540730 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:32.681724 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:32.690137 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-f9016aaf-3912-49b5-a27d-175767023c57 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.163629 Sep 19 11:38:32.690700 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 481/963] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:32 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:33.712691 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:33.713315 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:33.719958 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:33.720446 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:33.720886 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:33.721583 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:33.722071 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:33.722500 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:33.912827 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:33.921076 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-500e9c3c-dd93-43e6-8942-4fca7c4c57ee tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.212328 Sep 19 11:38:33.921693 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 483/964] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:33 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:34.945180 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:34.945756 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:34.952129 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:34.952601 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:34.953031 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:34.953721 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:34.954172 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:34.954595 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:35.142058 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:35.150739 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-8c5ff3f3-c577-4be6-819a-4106f26ce70e tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.210102 Sep 19 11:38:35.151300 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 482/965] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:34 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:36.173509 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:36.174133 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:36.181356 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:36.181845 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:36.182289 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:36.182989 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:36.183451 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:36.183920 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:36.327583 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:36.336216 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-c990c064-2402-4bbb-96dd-d60f17ab3825 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.166527 Sep 19 11:38:36.336778 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 484/966] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:36 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:37.359365 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:37.360028 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:37.366645 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:37.367143 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:37.367562 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:37.368279 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:37.368731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:37.369149 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:37.509061 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:37.517245 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e29b7872-6562-467f-bd24-8506dd971542 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1756 microversion: 2.1 time: 0.161773 Sep 19 11:38:37.517808 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 483/967] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:37 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:38:38.542462 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:38.543078 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:38.549243 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:38.549769 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:38.550215 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:38.550965 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:38.551425 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:38.551895 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:38.693824 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:38:38.702024 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-91789f2c-1caa-424c-8658-9c7e69da4f98 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1759 microversion: 2.1 time: 0.164141 Sep 19 11:38:38.702588 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 485/968] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:38:38 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:39:10.304551 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-574276477"}} {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:39:10.305198 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:10.307341 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_api:SELECT=16 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:39:10.308108 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG dbcounter [-] [120458] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:39:10.314211 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:10.314696 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:10.315133 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:10.315846 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:10.316305 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:10.316732 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:10.441962 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.network.security_group_api [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Removing security group f09da9df-0269-46de-97c5-960e740362ca from port bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 Sep 19 11:39:10.741955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-7ac7e43c-195d-46f8-acc4-b195dea91ad6 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/action" status: 202 len: 0 microversion: 2.1 time: 0.441275 Sep 19 11:39:10.742764 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 484/969] 10.222.0.81 () {60 vars in 1278 bytes} [Mon Sep 19 11:39:10 2022] POST /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:39:10.750134 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-cad4df01-adfa-4fed-8ce7-c993885dff30 req-32c28db6-cdb2-45eb-a0bc-c1f652a68b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:39:10.765811 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_api:SELECT=16 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:39:10.766836 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG dbcounter [-] [120459] Writing DB stats nova_cell1:SELECT=48 {{(pid=120459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:39:10.768047 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:39:10.768737 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Mon Sep 19 11:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.81) !!! Sep 19 11:39:10.790260 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-cad4df01-adfa-4fed-8ce7-c993885dff30 req-32c28db6-cdb2-45eb-a0bc-c1f652a68b6b service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:10.790741 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-cad4df01-adfa-4fed-8ce7-c993885dff30 req-32c28db6-cdb2-45eb-a0bc-c1f652a68b6b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:10.791179 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-cad4df01-adfa-4fed-8ce7-c993885dff30 req-32c28db6-cdb2-45eb-a0bc-c1f652a68b6b service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:10.810234 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-cad4df01-adfa-4fed-8ce7-c993885dff30 req-32c28db6-cdb2-45eb-a0bc-c1f652a68b6b service nova] Creating event network-changed:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:39:10.829356 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-cad4df01-adfa-4fed-8ce7-c993885dff30 req-32c28db6-cdb2-45eb-a0bc-c1f652a68b6b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082906 Sep 19 11:39:10.830143 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 486/970] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:39:11.777342 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:11.777854 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:11.779464 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-18b69b28-a332-4439-b9cf-e57467c8d0d5 req-71d19fcb-e0a9-421f-8709-d6829bef917d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:39:11.784673 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:11.785201 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:11.785649 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:11.786355 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:11.787050 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:11.787731 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:11.792002 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-18b69b28-a332-4439-b9cf-e57467c8d0d5 req-71d19fcb-e0a9-421f-8709-d6829bef917d service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:11.792470 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-18b69b28-a332-4439-b9cf-e57467c8d0d5 req-71d19fcb-e0a9-421f-8709-d6829bef917d service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:11.793118 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-18b69b28-a332-4439-b9cf-e57467c8d0d5 req-71d19fcb-e0a9-421f-8709-d6829bef917d service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:11.804904 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-18b69b28-a332-4439-b9cf-e57467c8d0d5 req-71d19fcb-e0a9-421f-8709-d6829bef917d service nova] Creating event network-changed:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:39:11.810427 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-18b69b28-a332-4439-b9cf-e57467c8d0d5 req-71d19fcb-e0a9-421f-8709-d6829bef917d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035068 Sep 19 11:39:11.811030 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 487/971] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:39:11.877641 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lazy-loading 'services' on Instance uuid 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:39:11.954776 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-b2a48b2f-9cee-4e4b-b3c3-29bad30bd0cf tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments/c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77" status: 202 len: 0 microversion: 2.1 time: 0.181102 Sep 19 11:39:11.955957 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 485/972] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:39:11 2022] DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments/c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:39:11.977264 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:11.980269 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:11.988640 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:11.990157 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:11.991475 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:11.992626 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:11.993991 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:11.994659 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:12.029279 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-3b506f10-d283-4e64-a7ff-feb87978cd94 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064822 Sep 19 11:39:12.030096 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 488/973] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:39:11 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:39:13.043747 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:13.046123 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:13.052955 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.053446 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.053887 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.054580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.055043 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.055471 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.083456 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e28b5705-2abf-4d51-8f37-3069e8759e48 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044501 Sep 19 11:39:13.083966 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 486/974] 10.222.0.81 () {58 vars in 1302 bytes} [Mon Sep 19 11:39:13 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:39:13.094521 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:13.095028 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:13.101858 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.102338 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.102779 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.103460 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.103951 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.104378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.177231 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] HTTP exception thrown: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 is not attached to volume c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Request method failure captured: Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments/c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 HTTP/1.1 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFRozo3DcHF8n4wYum76lqZj_CglN45-aC6STsuc-2PGwo8xi2p2cXVFFqELjIB-Ej_zqv9HtoFWJiT0EveO3MSLgYkQM9h3EPh-zIdNCMWWQx8QRfclKR9rb9J8bDo7cNOv83SUfVgWfKQk9yYxAdoSowelfSfILUB_xatMpNBcrFQ Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 67f0a300a82b480d8f4a2c0a19f94fb6 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-TestMinimumBasicScenario-1407232359 Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:39:13.179581 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67f0a300a82b480d8f4a2c0a19f94fb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67f0a300a82b480d8f4a2c0a19f94fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67f0a300a82b480d8f4a2c0a19f94fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67f0a300a82b480d8f4a2c0a19f94fb6"}]}] Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-TestMinimumBasicScenario-1407232359 Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 67f0a300a82b480d8f4a2c0a19f94fb6 Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1407232359 Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-TestMinimumBasicScenario-1407232359-project Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 1d4fe64743d747ccadb431ce88fbadcb Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-TestMinimumBasicScenario-1407232359-project Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:39:13.181378 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 is not attached to volume c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'server_id': '96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355', 'id': 'c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77'} Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77. Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:39:13.182342 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 is not attached to volume c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 is not attached to volume c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:13.184221 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Returning 404 to user: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 is not attached to volume c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:39:13.185522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5b29ceff-dcc4-4f84-ad3a-54ac7a893334 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments/c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77" status: 404 len: 154 microversion: 2.1 time: 0.090600 Sep 19 11:39:13.185522 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 489/975] 10.222.0.81 () {58 vars in 1416 bytes} [Mon Sep 19 11:39:13 2022] DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355/os-volume_attachments/c5ecfe2d-37a1-43f2-8d6a-56a0f559ed77 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:39:14.320580 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:14.321119 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:14.327382 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:14.327914 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:14.328387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:14.329079 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:14.329537 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:14.329979 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:14.353788 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Going to try to terminate instance {{(pid=120458) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:39:14.425769 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-c29c06e1-969d-46fd-a303-c4e5af659142 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 204 len: 0 microversion: 2.1 time: 0.108121 Sep 19 11:39:14.426267 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 487/976] 10.222.0.81 () {58 vars in 1239 bytes} [Mon Sep 19 11:39:14 2022] DELETE /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:39:14.436266 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:14.437018 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:14.444046 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:14.444527 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:14.444960 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:14.445643 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:14.446097 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:14.446518 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:14.574340 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.policy [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120459) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:39:14.581992 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-5bbbe03c-e7a5-4c68-8819-e1afc41eb493 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1555 microversion: 2.1 time: 0.151325 Sep 19 11:39:14.582572 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 490/977] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:39:14 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:39:15.605613 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:15.606306 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:15.613143 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:15.613647 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:15.614082 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:15.614763 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:15.615216 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:15.615638 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:15.977387 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:39:15.985197 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-e8b9b406-31c9-418f-bb80-801d3bb08035 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1555 microversion: 2.1 time: 0.383831 Sep 19 11:39:15.985765 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 488/978] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:39:15 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1555 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:39:16.563994 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [req-6b53fb5a-2e48-4979-ba7f-dfca5471f9c9 req-0e99afd9-f768-40d1-919e-54b9084413af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355", "name": "network-vif-deleted", "tag": "bc8c65b7-ea3a-4cc4-96be-166b58bf0e44"}]} {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:39:16.575130 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6b53fb5a-2e48-4979-ba7f-dfca5471f9c9 req-0e99afd9-f768-40d1-919e-54b9084413af service nova] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:16.575694 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6b53fb5a-2e48-4979-ba7f-dfca5471f9c9 req-0e99afd9-f768-40d1-919e-54b9084413af service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:16.576150 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [req-6b53fb5a-2e48-4979-ba7f-dfca5471f9c9 req-0e99afd9-f768-40d1-919e-54b9084413af service nova] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:16.587358 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.compute.server_external_events [req-6b53fb5a-2e48-4979-ba7f-dfca5471f9c9 req-0e99afd9-f768-40d1-919e-54b9084413af service nova] Creating event network-vif-deleted:bc8c65b7-ea3a-4cc4-96be-166b58bf0e44 for instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 on hv-cinder-82099 Sep 19 11:39:16.592268 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [req-6b53fb5a-2e48-4979-ba7f-dfca5471f9c9 req-0e99afd9-f768-40d1-919e-54b9084413af service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031918 Sep 19 11:39:16.592857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 491/979] 10.222.0.81 () {64 vars in 1317 bytes} [Mon Sep 19 11:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:39:17.008598 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:17.009225 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.compute.api [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120458) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:17.015193 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:17.015690 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:17.016164 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:17.016863 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:17.017322 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:17.017753 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:17.051242 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:17.051733 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:17.052205 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG oslo_concurrency.lockutils [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120458) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:17.052652 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.objects.instance [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lazy-loading 'fault' on Instance uuid 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 {{(pid=120458) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:39:17.097606 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.policy [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4fe64743d747ccadb431ce88fbadcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67f0a300a82b480d8f4a2c0a19f94fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120458) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:39:17.104757 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-2dbe289b-1e2e-4a4c-a76a-039909c6cf75 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 200 len: 1349 microversion: 2.1 time: 0.100641 Sep 19 11:39:17.105325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 489/980] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:39:17 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 1349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:39:18.127499 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '>' {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:18.128251 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.compute.api [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] [instance: 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355] Fetching instance by UUID {{(pid=120459) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:18.134416 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:18.134908 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:18.135353 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:18.136087 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Acquiring lock "c575dc0f-6975-4ee0-be74-9be0c3940462" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:18.136551 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:18.136983 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG oslo_concurrency.lockutils [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Lock "c575dc0f-6975-4ee0-be74-9be0c3940462" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120459) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:18.150587 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.wsgi [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] HTTP exception thrown: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 could not be found. Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Request method failure captured: Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: request: GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 HTTP/1.1 Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept: application/json Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Accept-Encoding: identity Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Connection: close Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Length: 0 Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Content-Type: application/json Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Host: 10.222.0.81 Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: Openstack-System-Scope: None Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: User-Agent: python-urllib3/1.26.12 Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Auth-Token: gAAAAABjKFRozo3DcHF8n4wYum76lqZj_CglN45-aC6STsuc-2PGwo8xi2p2cXVFFqELjIB-Ej_zqv9HtoFWJiT0EveO3MSLgYkQM9h3EPh-zIdNCMWWQx8QRfclKR9rb9J8bDo7cNOv83SUfVgWfKQk9yYxAdoSowelfSfILUB_xatMpNBcrFQ Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Id: None Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Domain-Name: None Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Identity-Status: Confirmed Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Is-Admin-Project: True Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Id: default Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Domain-Name: Default Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Id: 67f0a300a82b480d8f4a2c0a19f94fb6 Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Project-Name: tempest-TestMinimumBasicScenario-1407232359 Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Role: reader,member Sep 19 11:39:18.152227 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Roles: reader,member Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_67f0a300a82b480d8f4a2c0a19f94fb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/67f0a300a82b480d8f4a2c0a19f94fb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67f0a300a82b480d8f4a2c0a19f94fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/67f0a300a82b480d8f4a2c0a19f94fb6"}]}] Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant: tempest-TestMinimumBasicScenario-1407232359 Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Id: 67f0a300a82b480d8f4a2c0a19f94fb6 Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1407232359 Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User: tempest-TestMinimumBasicScenario-1407232359-project Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Id: default Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Domain-Name: Default Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Id: 1d4fe64743d747ccadb431ce88fbadcb Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: X-User-Name: tempest-TestMinimumBasicScenario-1407232359-project Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: method: > Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: exception: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 could not be found. Sep 19 11:39:18.153857 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: action_args: {'id': '96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355'} Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: {{(pid=120459) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 could not be found. Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:39:18.154884 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 could not be found. Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 could not be found. Sep 19 11:39:18.156453 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: ERROR nova.api.openstack.wsgi Sep 19 11:39:18.158108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: DEBUG nova.api.openstack.wsgi [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Returning 404 to user: Instance 96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 could not be found. {{(pid=120459) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:39:18.158108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: INFO nova.api.openstack.requestlog [None req-44355bdc-f4cb-47f5-9d32-a2c2ff53ace2 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355" status: 404 len: 111 microversion: 2.1 time: 0.030796 Sep 19 11:39:18.158108 dv-cinder-820994-5-iscsi devstack@n-api.service[120459]: [pid: 120459|app: 0|req: 492/981] 10.222.0.81 () {58 vars in 1236 bytes} [Mon Sep 19 11:39:18 2022] GET /compute/v2.1/servers/96a1b6e0-7ba0-4fc4-9f13-79acf7bc4355 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:39:18.162848 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: DEBUG nova.api.openstack.wsgi [None req-379d7275-9664-467d-8564-904936daee25 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] Calling method '.version_select at 0x7ff52173d3a0>' {{(pid=120458) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:18.180325 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: INFO nova.api.openstack.requestlog [None req-379d7275-9664-467d-8564-904936daee25 tempest-TestMinimumBasicScenario-1407232359 tempest-TestMinimumBasicScenario-1407232359-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1275017677" status: 202 len: 0 microversion: 2.1 time: 0.021821 Sep 19 11:39:18.180913 dv-cinder-820994-5-iscsi devstack@n-api.service[120458]: [pid: 120458|app: 0|req: 490/982] 10.222.0.81 () {58 vars in 1272 bytes} [Mon Sep 19 11:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1275017677 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)